-- Logs begin at Wed 2022-09-28 11:41:12 UTC, end at Wed 2022-09-28 12:36:36 UTC. -- Sep 28 12:07:58.596599 dv-cinder-844563-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 28 12:07:58.604207 dv-cinder-844563-9-smb devstack@keystone.service[81459]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 12:07:58 2022] *** Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: nodename: dv-cinder-844563-9-smb Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: machine: x86_64 Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: clock source: unix Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: pcre jit disabled Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: detected number of CPU cores: 4 Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: current working directory: / Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: detected binary path: /usr/bin/uwsgi-core Sep 28 12:07:58.606814 dv-cinder-844563-9-smb devstack@keystone.service[81459]: your processes number limit is 47680 Sep 28 12:07:58.607383 dv-cinder-844563-9-smb devstack@keystone.service[81459]: your memory page size is 4096 bytes Sep 28 12:07:58.607383 dv-cinder-844563-9-smb devstack@keystone.service[81459]: detected max file descriptor number: 2048 Sep 28 12:07:58.607383 dv-cinder-844563-9-smb devstack@keystone.service[81459]: lock engine: pthread robust mutexes Sep 28 12:07:58.607383 dv-cinder-844563-9-smb devstack@keystone.service[81459]: thunder lock: enabled Sep 28 12:07:58.607383 dv-cinder-844563-9-smb devstack@keystone.service[81459]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 28 12:07:58.607383 dv-cinder-844563-9-smb devstack@keystone.service[81459]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 12:07:58.646971 dv-cinder-844563-9-smb devstack@keystone.service[81459]: Python main interpreter initialized at 0x56252e84b9c0 Sep 28 12:07:58.646971 dv-cinder-844563-9-smb devstack@keystone.service[81459]: python threads support enabled Sep 28 12:07:58.646971 dv-cinder-844563-9-smb devstack@keystone.service[81459]: your server socket listen backlog is limited to 100 connections Sep 28 12:07:58.646971 dv-cinder-844563-9-smb devstack@keystone.service[81459]: your mercy for graceful operations on workers is 90 seconds Sep 28 12:07:58.647342 dv-cinder-844563-9-smb devstack@keystone.service[81459]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 12:07:58.647429 dv-cinder-844563-9-smb devstack@keystone.service[81459]: *** Operational MODE: preforking *** Sep 28 12:07:58.647654 dv-cinder-844563-9-smb devstack@keystone.service[81459]: *** uWSGI is running in multiple interpreter mode *** Sep 28 12:07:58.647654 dv-cinder-844563-9-smb devstack@keystone.service[81459]: spawned uWSGI master process (pid: 81459) Sep 28 12:07:58.647862 dv-cinder-844563-9-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 28 12:07:58.648808 dv-cinder-844563-9-smb devstack@keystone.service[81459]: spawned uWSGI worker 1 (pid: 81472, cores: 1) Sep 28 12:07:58.650336 dv-cinder-844563-9-smb devstack@keystone.service[81459]: spawned uWSGI worker 2 (pid: 81473, cores: 1) Sep 28 12:07:58.650336 dv-cinder-844563-9-smb devstack@keystone.service[81459]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 12:08:03.002976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:08:03.002976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 28 12:08:03.003747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:08:03.003747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 28 12:08:03.053031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:08:03.053220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:08:03.053413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] command line args: [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:08:03.053728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:08:03.053859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ================================================================================ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:08:03.054111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.054356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_dir = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.054542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.054722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_source = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.054900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] debug = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.055097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_config_append = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.056846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_dir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.057023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.057258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.057510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.057757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.058002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.058181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.058367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.058602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.058845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.059078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.059326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.059541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.059774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.060031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.060263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.060550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.061105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.061310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] publish_errors = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.061544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.061751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.061935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.062172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.062407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.062644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] standard_threads = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.062865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.063109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.063284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.063459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_journal = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.063634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_json = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.063808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_stderr = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.063998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_syslog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.064212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.064465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.064702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.064987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.065227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.065476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.065714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.065960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.066195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.066441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.066686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.066932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.067166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.067417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.067651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.067898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.068143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.068378 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.068631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.068905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.069149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.069383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.069637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.069897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.070150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.070396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.070628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.070858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.071088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.071322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.071567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.071810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.072039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.072268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.072513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.072758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.073018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.073265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.073495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.073732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.073964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.074193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.074422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.074651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.074881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.075116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.075362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.075592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.075827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.076056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.076291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.077051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.077538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.077538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.077788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.077979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.078215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.078449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.078684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.078913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.079160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.079638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.079880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.080112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.080368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.080603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.080863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.081097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.081333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.081600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.081836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.082084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.082327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.082563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.082797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.083030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.083274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.083509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.083745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.083986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.084221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.084466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.084701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.084957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.085426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.085660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.085917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.086156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.086402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.086641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.086876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.087115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.087355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.087591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.087826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.088056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.088286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.088515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.088748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.089001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.089242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.089477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.089725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.089962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.090218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.090474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.090714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.090945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.external = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.091174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.091467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.091699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.091929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.password = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.092721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.token = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.092993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.093232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.093517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.093750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.093995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.094242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.094473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.094708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.094953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.095200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.095445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.095686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.095929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.096164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.096408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.096659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.096916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.097170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.097456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.097700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.097961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.098204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.098459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.098694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.098931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.099178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.099422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.099653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.099897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.100131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.100383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.100617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.100892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.101129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.101375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.101609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.101855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.102099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.102333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.102566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.102812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.103041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.103277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.103523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.103771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.104001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.104233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.104461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.104704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.104974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.105222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.105477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.105721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.105989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.106226 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.106461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.106698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.106933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.107165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.107398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.107637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.108163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.108416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.108650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.108920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.109169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.109420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.109656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.109901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.110132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.110368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.110600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.110835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.111070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.111311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.111547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.111908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.112162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.112414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.112647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.112915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.113155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.113404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.113642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.113879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.114116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.114350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.114591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.114850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.115082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.115332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.115578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.115825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.116060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.116290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.116524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.116758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.117015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.117246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.117497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.117743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.117987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.118232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.118478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.118708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.118952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.119188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.119424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.119660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.119895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.120139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.120387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.120624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.120900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.121132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.121375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.121611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.121846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.122080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.122326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.122566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.122801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.123038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.123785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.124042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.124332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.124511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.124757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.125026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.125261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.125506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.125740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.125978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.126212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.126458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.126688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.126938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.127184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.127436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.127682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.127925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.128170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.128414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.128660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.128911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.129158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.129403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.129647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.129891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.130296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.130532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.130780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.131029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.131276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.131524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.131758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.132011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.132263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.132502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.132733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.132990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.133223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.133472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.133724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.133967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.134204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.134438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.134666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.134899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.135134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.135381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.135615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.135869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.136114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.136349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.136592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.136854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.137100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.137341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.137576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.137810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.138054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.138330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.138557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.138798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.139600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.139870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.140116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.140365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.140603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.140866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.141102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.141339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.141573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.141821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.142057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.142290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.142534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.142767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.143013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.143247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.143490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.143719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.143957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.144191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.144359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:08:03.160394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:08:03.160394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: from cryptography.utils import int_from_bytes Sep 28 12:08:03.160994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:08:03.160994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: from cryptography.utils import int_from_bytes Sep 28 12:08:03.173561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.173795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.174023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.182492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.211674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.211902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.218057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:08:03.218255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:08:03.218458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] command line args: [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:08:03.218733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:08:03.218911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ================================================================================ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:08:03.219164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] admin_token = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.219410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config_dir = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.219596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.219777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] config_source = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.219957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] debug = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.220167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.220406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.220583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.220859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.221109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.221339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.221517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_config_append = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.221678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.221852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_dir = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.222027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.222260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.222507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.222750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.222992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.223167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.223339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.223580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.223820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.224051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.224282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.224515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.224745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.225014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.225368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.225519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.226006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.226183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] publish_errors = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.226412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.226639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.226813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.227054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.227290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.227522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] standard_threads = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.227749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.227989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.228161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.228333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_journal = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.228505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_json = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.228676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_stderr = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.228872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] use_syslog = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.229101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:08:03.229352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.229590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.229846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.230082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.230328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.230562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.230807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.231040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.231285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.231528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.231776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.232006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.232248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.232479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.232755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.233225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.233582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.233841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.234098 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.234346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.234582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.234836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.235096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.235349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.235597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.235829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.236060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.236289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.236523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.236769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.237037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.237271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.237500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.237743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.237988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.238224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.238468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.238697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.238931 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.239173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.239402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.239630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.239857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.240085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.240317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.240561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.240856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.241040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.241269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.241502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.241732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.241977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.242204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.242437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.242670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.242902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.243133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.243367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.243594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.243838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.244069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.244303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.244533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.244794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.245039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.245269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.245503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.245737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.246003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.246237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.246485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.246730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.246966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.247204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.247438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.247682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.247917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.248153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.249042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.249475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.249851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.250100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.250343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.250585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.250827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.251064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.251325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.251568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.251818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.252059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.252297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.252540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.252809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.253035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.253269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.253499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.253729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.253958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.254189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.254418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.254656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.254890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.255135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.255371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.255625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.255879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.256119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.external = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.256581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.256902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.257139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.257370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.password = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.257604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] auth.token = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.257842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.258076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.258321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.258550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.258796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.259041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.259270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.259503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.259746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.259992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.260237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.260484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.260727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.260987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.261233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.261483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.261719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.261969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.262248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.262493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.262755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.262997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.263251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.263484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.263719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.264029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.264989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.265318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.265571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.265809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.265888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.266065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.266302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.266557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.266794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.267039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.267274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.267520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.267771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.268006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.268240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.268485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.268714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.268973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.269221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.269470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.269700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.269930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.270157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.270399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.270643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.270887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.271139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.271384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.271651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.271886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.272121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.272350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.272583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.272831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.273065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.273301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.273537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.273782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.274011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.274255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.274495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.274728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.274970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.275211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.275439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.275675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.275904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.276139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.276374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.276613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.276872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.277109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.277355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.277604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.277833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.278061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.278304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.278546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.278779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.279012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.279354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.279625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.280082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.280414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.280649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.280924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.281176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.281424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.281660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.281892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.282128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.282362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.282598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.282831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.283075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.283320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.283564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.283808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.284051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.284280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.284523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.284755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.285011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.285247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.285480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.285722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.285968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.286202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.286454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.286682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.286922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.287155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.287387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.287626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.287869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.288107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.288336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.288571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.288832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.289082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.289327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.289560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.289807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.290055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.290288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.290532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.290766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.291002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.291234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.291477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.291704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.291949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.292194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.292437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.292681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.292946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.293190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.293431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.293676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.293905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.294146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.294388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.294631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.294873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.295375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.295800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.296165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.296420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.296672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.296948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.297187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.297443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.297702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.297942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.298175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.298407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.298638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.298889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.299143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.299388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.299622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.299854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.300082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.300314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.300547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.300811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.301049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.301304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.301551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.301786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.302029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.302272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.302519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.302756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.302993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.303226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.303470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.303784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.303971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.304212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.304476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.304735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.305004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.305252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.305488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.305728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.305962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.306196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.306430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.306666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.306909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.307144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.307386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.307624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.307868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.308102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.308346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.308577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.308839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.309075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:08:03.309241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:08:03.314440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.314675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.335509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.335737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.335958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.344517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.363082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.363307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.405219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.442546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.442773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.465517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.465748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.465971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.466192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.466412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.466627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.491773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.491990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.492212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.492429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.492645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.492883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.493100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.505277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.519284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.519517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.519742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.519962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.520177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.520389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.520601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.538626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.538847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:08:03.539204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.539407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:08:03.539687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.539950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.540210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.540469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.550568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.550864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.551144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.551432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.558471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.561432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.561721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.562008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.562292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.562579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.562842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.563116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.563392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.563660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.563934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.564204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.573967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.574202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.574427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.574648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.574865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.575085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.588259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.588487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.588709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.588954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.589170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.589382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.589594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.591937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.593975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.594262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.598109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.599091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.599376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.599658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.601179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.601407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.601633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.601852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.602065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.602274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.602481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 12:08:03.606975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.607308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.612716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.612952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:08:03.613289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.613495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 12:08:03.613767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.614023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.614222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.614307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.614514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.614596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.614798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.615079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.615354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.615634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.615904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.616176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.624213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.624493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.624764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.625078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.631715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.631993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.632091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.635100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.635382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.635662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.635853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.635950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.636227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.636488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.636755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.637050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.637332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.637603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.637875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.639608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.639901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.644082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.647225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.650416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.650718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.651006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.651291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.651583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.651882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.661396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.662847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.663135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.667600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.667688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.667893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.667976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.668166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.668267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.668430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.675444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.675725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.675809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.677311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.678822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.679101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.679724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.680018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.680299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.680587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.680897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.682023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.682305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.682595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.682730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.682887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.683018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.683273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.683354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.694924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.695210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.695493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.695790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.696173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.696462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.696745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.699419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.699697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.703789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.707140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.707437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.711715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.712331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.714815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.715257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.718238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.718411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.718533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.718819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.719213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.719498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.719787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.719871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.721299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.721585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.721995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.728319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.729807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.733205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.733607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.733896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.734176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.736155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.736442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.736709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.736999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.741964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.742256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.742541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.743654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.745317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.746830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.747103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.749988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.750271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.750552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.750632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.750828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.750910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.751936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.752212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.752483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.752762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.753074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.753385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.753663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.762774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.763059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.763338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.763618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.763910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.764379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.764880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.780168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.783233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.786139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.787549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.787665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56252e84b9c0 pid: 81472 (default app) Sep 28 12:08:03.789018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.789294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.789663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.790961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526fef-c67c-4a37-a36d-63c805e14e75 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:03.791250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526fef-c67c-4a37-a36d-63c805e14e75 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:03.791521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526fef-c67c-4a37-a36d-63c805e14e75 None None] PATH_INFO: `/v3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:03.797946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Sep 28 12:08:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:03.798132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.798622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.801480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.801772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.802052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.802331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.810248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.810491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.810769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.818548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 12:08:03.818828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.819106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.819388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.819658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.819936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.820207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.820471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.820738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.821046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.821335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.821600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.821861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.822119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 12:08:03.857386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56252e84b9c0 pid: 81473 (default app) Sep 28 12:08:10.575848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:10.576892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:10.577029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:10.578461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:10.586272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:10.586853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:10.586853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:10.658854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: INFO dbcounter [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] Registered counter for database keystone Sep 28 12:08:10.678073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG oslo_db.sqlalchemy.engines [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:08:10.684175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writer thread running {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:08:10.864436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG passlib.handlers.bcrypt [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81473) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 28 12:08:10.864741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG passlib.handlers.bcrypt [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81473) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 28 12:08:10.922892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:10.924491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:11.055147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 28 12:08:11.504045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:11.573129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: INFO dbcounter [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] Registered counter for database keystone Sep 28 12:08:11.594795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG oslo_db.sqlalchemy.engines [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:08:11.600919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writer thread running {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:08:11.719409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d691b2-8510-491b-8bce-2493a1f3c585 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:11.723617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:11.724236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:11.724514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:11.724796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:11.733527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:11.784296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 28 12:08:11.784581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0665c2f-459c-4323-a2a5-2cee24355cef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:11.793816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 28 12:08:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:08:11.799916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:11.815373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8640f34-a753-40bf-930e-769cdea815b8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:11.819753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:11.820889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:11.821170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:11.821435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] PATH_INFO: `/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:11.822889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0ec0cb5de3946ab8e99e7fe425ccea6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:11.876476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 28 12:08:11.876845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9b6e-3941-4a96-9121-27c7c31a2d62 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:11.881407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Sep 28 12:08:11 2022] GET /identity/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:14.019912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1774ac7-b25c-4d6d-81ff-9d084d321801 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:14.020421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1774ac7-b25c-4d6d-81ff-9d084d321801 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:14.020421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1774ac7-b25c-4d6d-81ff-9d084d321801 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:14.024533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:14.030255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:14.030659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:14.030816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:14.051444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:14.052973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:14.060864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 28 12:08:14.325312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1774ac7-b25c-4d6d-81ff-9d084d321801 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:14.337952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1774ac7-b25c-4d6d-81ff-9d084d321801 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:14.342107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568019-1146-49f7-9b0a-39a0e55dc86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:14.343172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568019-1146-49f7-9b0a-39a0e55dc86d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:14.343451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568019-1146-49f7-9b0a-39a0e55dc86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:14.343723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568019-1146-49f7-9b0a-39a0e55dc86d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:14.351212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568019-1146-49f7-9b0a-39a0e55dc86d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:14.352994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568019-1146-49f7-9b0a-39a0e55dc86d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:14.361689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 28 12:08:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:08:14.366989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:14.376601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f9cff-7b49-4250-9bc4-34232e16e718 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:14.380944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b325-25bd-4eee-8017-b3e481d74944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:14.381572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b325-25bd-4eee-8017-b3e481d74944 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:14.381849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b325-25bd-4eee-8017-b3e481d74944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:14.382121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b325-25bd-4eee-8017-b3e481d74944 admin admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:14.383419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765b325-25bd-4eee-8017-b3e481d74944 admin admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:14.385259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765b325-25bd-4eee-8017-b3e481d74944 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:14.386772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Sep 28 12:08:14 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:16.630618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8111e-77e5-41fd-9428-f79dae089325 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:16.631189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8111e-77e5-41fd-9428-f79dae089325 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:16.631189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8111e-77e5-41fd-9428-f79dae089325 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:16.632487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:16.637008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b17a5-b1a2-4e60-8cc8-632519ba2cdf None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:16.637439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b17a5-b1a2-4e60-8cc8-632519ba2cdf None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:16.637531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:16.637620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b17a5-b1a2-4e60-8cc8-632519ba2cdf None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:16.637785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:16.637901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:16.638962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 5/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:16.643858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:16.644158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:16.644432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:16.662544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:16.663723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:16.680690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81472) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 28 12:08:16.681113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81472) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 28 12:08:16.730099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:16.731669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:16.743982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:16.830918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:17.016590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.041230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.097416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.121956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c0ed-9899-430f-a169-16d272d1bca0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.155031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.155664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.155947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.156217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.167413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:17.177076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:17.177980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:17.179030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:17.183963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.199820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a92eb-5899-4a2b-8a8a-d838fbf24528 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.202161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.238184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.239041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.239318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.239589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.264761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.283045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b6a4e-aea2-4242-885b-7438462475fb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.304833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.306350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.316900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.317507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.317784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.318050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.318709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:17.319004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.320401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.332507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:17.338070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.402300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:08:17.408619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.411537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.435728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f57cf-d0df-4fd9-852c-65639fe7a9f7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.469247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.469871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.470208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.470490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.471648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.473148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.474715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:17.480197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.496564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.508764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f67e2-e2ec-456c-ba49-21acff6f1e07 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.542557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.543331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.543604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.543864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.562422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.563868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.580298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089cb99-ea68-44e1-ac12-680a7a88d0a1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:08:17.581865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:17.582702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:08:17.583525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:08:17.583525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:08:17.583525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:17.583525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:17.588867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.619897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.620532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.620842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.621121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.622249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.623861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.625434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:17.631118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:17.643620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.689925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbcf92-ba0e-43d6-8e33-052053d86937 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.712259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:17.723914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.724523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.724822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.725096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.725734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:17.726030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.727398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37db57-50ef-4812-a44e-979afa657c98 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.731731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c615-25f4-4e15-b63d-f8cc45e9e866 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:17.744736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:17.766947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:17.767569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:17.767850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:17.768113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:17.768885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.domain.id=default, user.id=b23092081c294ccc9f338033bf5ecc16) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:17.769189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:17.770663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402465-1bf3-4eae-bdc3-f0b16c2c1ee9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:17.778164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 28 12:08:17 2022] GET /identity/v3/role_assignments?user.id=b23092081c294ccc9f338033bf5ecc16&scope.domain.id=default&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:20.277329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e90a-433c-4c8e-8776-958f785f63cb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:20.277832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e90a-433c-4c8e-8776-958f785f63cb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:20.277930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e90a-433c-4c8e-8776-958f785f63cb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:20.279219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:20.294670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d1dc8-5533-4dae-82e9-e2d517ce4092 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:20.295758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d1dc8-5533-4dae-82e9-e2d517ce4092 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:20.295758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d1dc8-5533-4dae-82e9-e2d517ce4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:20.325014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c78d1dc8-5533-4dae-82e9-e2d517ce4092 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:20.326212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c78d1dc8-5533-4dae-82e9-e2d517ce4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:20.418075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:20.453194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8a390-22d1-4af6-902a-e9836ae5b966 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:20.453512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8a390-22d1-4af6-902a-e9836ae5b966 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:20.453742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8a390-22d1-4af6-902a-e9836ae5b966 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:20.455350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:20.461075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04673e-5f23-48d5-afb0-dab6e25886b1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:20.461365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04673e-5f23-48d5-afb0-dab6e25886b1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:20.461636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04673e-5f23-48d5-afb0-dab6e25886b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:20.485761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-af04673e-5f23-48d5-afb0-dab6e25886b1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:20.486946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-af04673e-5f23-48d5-afb0-dab6e25886b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:20.571367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:20.899345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8a390-22d1-4af6-902a-e9836ae5b966 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:20.979210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1aff-c4fd-47b7-a0ef-355507e212d0 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:20.979521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1aff-c4fd-47b7-a0ef-355507e212d0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:20.979758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1aff-c4fd-47b7-a0ef-355507e212d0 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:20.981287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:20.987369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300f68f-4a93-4a27-9c51-c57f2a2c2858 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:20.987921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300f68f-4a93-4a27-9c51-c57f2a2c2858 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:20.988387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300f68f-4a93-4a27-9c51-c57f2a2c2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:20.995826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.015481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5300f68f-4a93-4a27-9c51-c57f2a2c2858 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:21.017104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5300f68f-4a93-4a27-9c51-c57f2a2c2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:21.042946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8a390-22d1-4af6-902a-e9836ae5b966 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:21.073137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.105850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:21.107042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.108411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.108930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.133708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:21.135167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:21.142855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:21.144365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2bf0d-0c9f-4890-9b45-91b76e3ab68b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.144948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2bf0d-0c9f-4890-9b45-91b76e3ab68b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.145425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2bf0d-0c9f-4890-9b45-91b76e3ab68b None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.146916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 16/28] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:21.147852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2bf0d-0c9f-4890-9b45-91b76e3ab68b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1ed8ddc2-bbe9-48b3-8cd3-bb08e758bba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:08:21.152916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:21.153733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:08:21.155086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:08:21.155086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:08:21.155086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:21.158388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 13/29] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:21.159819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.160307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.160804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.187272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:21.188854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:21.320812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2bf0d-0c9f-4890-9b45-91b76e3ab68b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:21.324109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 14/30] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:21.325628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:21.374578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:21.375270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.375492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.375756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.382426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.400373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:21.406050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:21.406912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:21.407641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 17/31] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:21.413921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:21.439041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.443672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0abf-cf8f-46f1-8619-2c76d2317456 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:21.489468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:21.490450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.490961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.491581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.492599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:21.493155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:21.494967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:21.528202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 15/32] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:21.557906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:21.591776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085cd8-9c7e-4bba-93ff-67d8759d3127 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:21.646247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:21.647257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.648018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.648912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.649875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:21.650416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:21.652051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:21.662751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 18/33] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:21.663882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:21.732135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f9b0-1f97-414f-af34-7ff3d8da4ad3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:21.735467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.767867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:21.768489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.768766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.769062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.769945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:21.771396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:21.783707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a593c7-5054-4060-8793-cab8af42d9f4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:21.826320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:21.826916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:21.827196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:21.827465 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:21.828128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:21.829533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:21.910019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 16/34] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:08:21 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:21.910993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:21.933627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:21.955610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 19/35] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 28 12:08:21 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:21.956869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:22.045862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b557-6d28-4da5-92af-9f644d724142 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:22.095613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599a34-7b99-4c10-a03d-888bb7745412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:22.096282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599a34-7b99-4c10-a03d-888bb7745412 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.096565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599a34-7b99-4c10-a03d-888bb7745412 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.096874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599a34-7b99-4c10-a03d-888bb7745412 None admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.099442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599a34-7b99-4c10-a03d-888bb7745412 None admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:22.101385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599a34-7b99-4c10-a03d-888bb7745412 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:22.103650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 17/36] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:21 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:22.105292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f891-2d03-47c9-bd16-1ea25ba941d3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.105577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f891-2d03-47c9-bd16-1ea25ba941d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.105849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f891-2d03-47c9-bd16-1ea25ba941d3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.107108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 18/37] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:22.108095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70197-feb0-483a-b1b7-cdee464d576a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:22.113976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f891-2d03-47c9-bd16-1ea25ba941d3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:22.148501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:22.205939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd843d3-c9a0-4227-8e20-3f8dbafb077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:22.206943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd843d3-c9a0-4227-8e20-3f8dbafb077a None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.206943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd843d3-c9a0-4227-8e20-3f8dbafb077a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.207142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd843d3-c9a0-4227-8e20-3f8dbafb077a None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.207703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd843d3-c9a0-4227-8e20-3f8dbafb077a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:22.210168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd843d3-c9a0-4227-8e20-3f8dbafb077a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:22.232273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 28 12:08:21 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:22.234108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ecce-0a02-483c-abf1-a489ccf2c119 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.234387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ecce-0a02-483c-abf1-a489ccf2c119 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.234655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ecce-0a02-483c-abf1-a489ccf2c119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.242834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:22.264332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0aa3ecce-0a02-483c-abf1-a489ccf2c119 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:22.266225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0aa3ecce-0a02-483c-abf1-a489ccf2c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:22.279564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f891-2d03-47c9-bd16-1ea25ba941d3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:22.323996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffd512-9072-49ea-834b-6bb1816b5813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:22.324648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd512-9072-49ea-834b-6bb1816b5813 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.325188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd512-9072-49ea-834b-6bb1816b5813 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.325370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd512-9072-49ea-834b-6bb1816b5813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.327167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffd512-9072-49ea-834b-6bb1816b5813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:22.328840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffd512-9072-49ea-834b-6bb1816b5813 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:22.331245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 19/39] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:22.336849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ded31-06fc-46b7-8a25-9e9fe96af326 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.336849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ded31-06fc-46b7-8a25-9e9fe96af326 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.336849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ded31-06fc-46b7-8a25-9e9fe96af326 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.336849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 20/40] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:22.340197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ded31-06fc-46b7-8a25-9e9fe96af326 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:22.363380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 21/41] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:22.364663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.365012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.365284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.481753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ded31-06fc-46b7-8a25-9e9fe96af326 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:22.497230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:22.498648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:22.518773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:22.519445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.519728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.520005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] PATH_INFO: `/v3/domains/default/users/b23092081c294ccc9f338033bf5ecc16/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.522005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b23092081c294ccc9f338033bf5ecc16, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:22.523461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:22.540873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Sep 28 12:08:22 2022] PUT /identity/v3/domains/default/users/b23092081c294ccc9f338033bf5ecc16/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:08:22.587172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 22/43] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:22.648484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:22.659869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:22.760734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2693488-5c63-4534-9f66-82d32d097edf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:22.796637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:22.797285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:22.797563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:22.797832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:22.798504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:22.799865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:22.816341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 28 12:08:22 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:08:22.854635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:22.895135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:22.970441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb867cdc-da46-4496-ba52-0545d2f58c9c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:23.012672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c0f8-e68b-4a69-b58c-623518427aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:23.013255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c0f8-e68b-4a69-b58c-623518427aaf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:23.013531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c0f8-e68b-4a69-b58c-623518427aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:23.013831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c0f8-e68b-4a69-b58c-623518427aaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:23.014950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95c0f8-e68b-4a69-b58c-623518427aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:23.016442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95c0f8-e68b-4a69-b58c-623518427aaf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:23.018267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:23.023639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:23.089723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:23.125037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02217ea5-fbc9-4952-9b00-add4c2e25132 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:23.157938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93de4a-d637-41d1-a2a4-f38a708f81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:23.158540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93de4a-d637-41d1-a2a4-f38a708f81c5 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:23.158817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93de4a-d637-41d1-a2a4-f38a708f81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:23.159084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93de4a-d637-41d1-a2a4-f38a708f81c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:23.159728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93de4a-d637-41d1-a2a4-f38a708f81c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:23.161167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93de4a-d637-41d1-a2a4-f38a708f81c5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:23.187608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:08:23 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:24.714049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14714de-768e-4ef6-a47a-03edaa96b2fa None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:24.714568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14714de-768e-4ef6-a47a-03edaa96b2fa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:24.714568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14714de-768e-4ef6-a47a-03edaa96b2fa None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:24.715954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:24.721179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:24.721564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:24.721837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:24.740559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:24.742085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:24.807401 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:25.079852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14714de-768e-4ef6-a47a-03edaa96b2fa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.178864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14714de-768e-4ef6-a47a-03edaa96b2fa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.181123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:25.212761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b193d6-58b8-469e-a42b-35744ff0185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.213448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b193d6-58b8-469e-a42b-35744ff0185c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.213725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b193d6-58b8-469e-a42b-35744ff0185c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.213994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b193d6-58b8-469e-a42b-35744ff0185c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.226386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b193d6-58b8-469e-a42b-35744ff0185c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-08b193d6-58b8-469e-a42b-35744ff0185c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:25.231516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:25.232402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:25.234152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:25.239584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.287479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:25.334978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af911-7a34-4e7a-9c86-3c53e534df2d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.335191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af911-7a34-4e7a-9c86-3c53e534df2d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.335491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af911-7a34-4e7a-9c86-3c53e534df2d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.337937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 26/50] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:25.338101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4755-3da7-4ad2-bacc-07f7b813ced3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.341801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.342819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.343126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.360757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:25.361980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:25.371347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.371951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.372231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.372499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.373177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:25.373474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:25.374833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:25.386128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:25.392299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.429325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 27/52] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:25.489196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9451c-7220-4930-a67d-d92cda78afb5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.499555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:25.522638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.523263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.523546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.523822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.524976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:25.526428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:25.528009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:25 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:25.534303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.623889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:25.630769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989785-6b2e-4fb0-b969-68bfc00ac22d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.664150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.664794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.665076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.665349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.666457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:25.667901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:25.669519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:25.675472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.698259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.775914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f92af-ea4a-449b-b38f-d0854dfb04ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.798951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c644c29-a53d-4542-a7c2-7db2b5880898 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.836482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.837158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.837438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.837707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.838878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:25.840367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:25.842529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:25.848225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:25.880535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:25.913906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.914501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.914778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.915048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.915766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.domain.id=default, user.id=b23092081c294ccc9f338033bf5ecc16) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:25.916067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:25.917524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9e5d0-4b4e-4f6a-8bf3-c02ab53f6fb0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:25.925853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 28 12:08:25 2022] GET /identity/v3/role_assignments?user.id=b23092081c294ccc9f338033bf5ecc16&scope.domain.id=default&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 530 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:25.950407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa325-1a26-412f-af95-54524f3589c8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:25.987719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5597bf-9de8-45a7-b1b2-21b93322a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:25.988347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5597bf-9de8-45a7-b1b2-21b93322a828 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:25.988628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5597bf-9de8-45a7-b1b2-21b93322a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:25.988935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5597bf-9de8-45a7-b1b2-21b93322a828 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:25.989609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5597bf-9de8-45a7-b1b2-21b93322a828 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:25.991104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5597bf-9de8-45a7-b1b2-21b93322a828 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:26.023105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 28 12:08:25 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:08:28.179011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523029-64ed-4abd-a07b-cae7c042909b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:28.179524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523029-64ed-4abd-a07b-cae7c042909b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:28.179606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523029-64ed-4abd-a07b-cae7c042909b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:28.180942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:28.186104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:28.186520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:28.186768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:28.204521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:28.206002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:28.269344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:28.537273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523029-64ed-4abd-a07b-cae7c042909b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:28.581569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:28.636397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523029-64ed-4abd-a07b-cae7c042909b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:28.668386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0588c1-8bf5-403b-80ca-63f81122836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:28.669023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0588c1-8bf5-403b-80ca-63f81122836e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:28.669301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0588c1-8bf5-403b-80ca-63f81122836e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:28.669570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0588c1-8bf5-403b-80ca-63f81122836e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:28.671270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0588c1-8bf5-403b-80ca-63f81122836e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:28.672686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0588c1-8bf5-403b-80ca-63f81122836e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:28.674247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:28.679939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:28.693674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:28.777939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059079b4-0a04-4e05-9fea-e484c88ab318 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:28.814615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d371-2c40-4f02-ad81-0ee8415ee0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:28.815228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d371-2c40-4f02-ad81-0ee8415ee0f9 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:28.815509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d371-2c40-4f02-ad81-0ee8415ee0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:28.815779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d371-2c40-4f02-ad81-0ee8415ee0f9 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:28.816427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d371-2c40-4f02-ad81-0ee8415ee0f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:28.817926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d371-2c40-4f02-ad81-0ee8415ee0f9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:28.845162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:08:28 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:32.110359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963ccf-e4a1-472f-899d-04191e0ef034 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.110359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963ccf-e4a1-472f-899d-04191e0ef034 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.110359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963ccf-e4a1-472f-899d-04191e0ef034 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.111286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:32.116899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0382-95cb-4495-84b0-7ecfa0c1834a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.117710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0382-95cb-4495-84b0-7ecfa0c1834a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.118195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0382-95cb-4495-84b0-7ecfa0c1834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.137295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-537e0382-95cb-4495-84b0-7ecfa0c1834a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:32.139330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-537e0382-95cb-4495-84b0-7ecfa0c1834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:32.222398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:32.229720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 33/63] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:32.409979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4fd2-7ca2-4c17-b11f-7a0fe6e33efd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.410592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4fd2-7ca2-4c17-b11f-7a0fe6e33efd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.411094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4fd2-7ca2-4c17-b11f-7a0fe6e33efd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.413049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 31/64] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:32.418645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ea6ee-fb7c-4226-b57c-5409f611c676 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.419173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ea6ee-fb7c-4226-b57c-5409f611c676 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.419640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ea6ee-fb7c-4226-b57c-5409f611c676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.446019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5e6ea6ee-fb7c-4226-b57c-5409f611c676 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:32.447858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5e6ea6ee-fb7c-4226-b57c-5409f611c676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:32.537388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:32.539251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9dafe-e548-46fe-aeff-a664c00e69c9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.539713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9dafe-e548-46fe-aeff-a664c00e69c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.540156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9dafe-e548-46fe-aeff-a664c00e69c9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.541937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 32/66] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:32.558731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290c05b-467d-4fc4-8f81-81b8663f8c08 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.559449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290c05b-467d-4fc4-8f81-81b8663f8c08 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.559902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290c05b-467d-4fc4-8f81-81b8663f8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.592274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c290c05b-467d-4fc4-8f81-81b8663f8c08 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:32.594026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c290c05b-467d-4fc4-8f81-81b8663f8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:32.621149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9dafe-e548-46fe-aeff-a664c00e69c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:32.679021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:32.718774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea88d-143e-475a-918e-b531303bf2ad None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.719399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea88d-143e-475a-918e-b531303bf2ad None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.719912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea88d-143e-475a-918e-b531303bf2ad None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.722088 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 36/68] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:32.734089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.734648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.735115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.760429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:32.762909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:32.817934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9dafe-e548-46fe-aeff-a664c00e69c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:32.833275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:32.841270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:32.856596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:32.858029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:32.881480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:32.882139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:32.882423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:32.882698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:32.910582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:32.917021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:32.918134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:32.919107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 33/70] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:32.924409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:32.975778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d60a7-1d00-4160-9b7e-475014520af8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.022921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.023911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.024425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.024958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.037871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:33.042720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:33.043534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:33.044317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 38/71] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:33.046217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.059687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0614ef-c177-4513-a7f8-9b98af556a31 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.093950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.094564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.094844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.095110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.095767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:33.096058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.097533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18af57-de54-45da-b2f4-edaf9ae108e9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.099965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.106968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 34/72] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.111444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e78ab-63fd-4c14-9659-6194df964e89 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.111444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e78ab-63fd-4c14-9659-6194df964e89 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.111444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e78ab-63fd-4c14-9659-6194df964e89 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.111444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 35/73] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:33.111444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e78ab-63fd-4c14-9659-6194df964e89 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.142025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.163626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f181-fcb7-40a1-96b2-63324fb04352 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.199886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.200887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.201666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.202157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.213301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:33.217611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e78ab-63fd-4c14-9659-6194df964e89 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:33.219485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:33.220305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:33.221085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 39/74] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:33.222325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.266900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.267429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.267708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.267975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.268653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:33.268958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.270337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08a055-5693-40d9-bb1c-38b6a8630795 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.278388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.279396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.279828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.280323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.298557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:33.299756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:33.331895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfd5ae-ee5c-4325-892e-bd3c485a3b51 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.341736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.365746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:33.366315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.366802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.366967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.367224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.367495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.391935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.396458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.398065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.399785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.400436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.473541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf186ceb-9853-46d3-944b-6aeaaaf29b9e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.505965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04d184-0fc4-4953-a494-826579c459be None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.512711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.514382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.514662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.514931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.526432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:33.531616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:33.532456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:33.533256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 38/78] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:33.533874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.547885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.548493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.548784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.549079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.549743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:33.550049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.551430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.559770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 41/79] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.562036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.596051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.621284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.639173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad63e-7572-4de3-ab5d-e1c69fda4b53 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.674441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340fffa-a2a3-44a1-ae3e-5361952adb58 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.675330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.675956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.676233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.676510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.677666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.679160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.680737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 39/80] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.681526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.711506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.712106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.712383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.712648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.779135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497d91-653c-490c-bdb5-634205c8004f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.783776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.785261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.811396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.815565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.816170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.816454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.816730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.817419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:33.817724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.819102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.827964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 40/81] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.828784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.844814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:33.890296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 42/82] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:33.891138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.932615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490e2ee-6c32-4957-9b8b-ae1c1fb3df7e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:33.965139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:33.965761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:33.966039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:33.966306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:33.968324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:33.969797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:33.971358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 41/83] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:33.972152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:33.989911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ce09-b055-4123-9453-8544a63e66fc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.018590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.028569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.029814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.030053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.030322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.031559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.033050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.034691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 43/84] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:34.035477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.054572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.072464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e65b4-8fac-4009-ad55-aca5d15c2664 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.105383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.105990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.106266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.106534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.134721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fddc64-6129-48c9-a9db-1fbb469bbfbc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.169126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.169749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.170641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.171014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.171649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.172150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.173132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.173626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.175199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 44/85] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:34.175957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.240200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.260767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.280360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:34.281140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.281756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639125-579f-4297-ab21-6ca6f58a1cdc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.315172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.315796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.316073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.316343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.317493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.318929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.320682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 45/87] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:34.321376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.380610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aa3b8-7026-42a6-8a98-2a59d4ae38c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.413999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.414602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.414908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.415185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.418894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324badb-a8b4-4d5d-b8df-5f7774fa50ed None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.448066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.454954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.455818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.456458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.456737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.457729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.459185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.464025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.479871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 46/88] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:08:34 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:34.480764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.483785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.485297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.595083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 43/89] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:34.600041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.617076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7a01f-0c08-4e6b-934a-af29895ce2ac None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.656050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.656670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.656974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.657245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.688880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.712165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd71540-7ad8-406f-b60f-5e0f498f7c9d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.723998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:34.740394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.742175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.753409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.754142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.754493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.754841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.756113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.757723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.759506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 44/90] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:34.760291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.881417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 47/91] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:34.882351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.887513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39b557-76ed-4638-9b62-c49e6ed9d915 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:34.937841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:34.938787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:34.939344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:34.939636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:34.940384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=98bbfc1dec994eac983e7237ae779d68) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:34.940878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:34.942990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:34.949961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/role_assignments?user.id=98bbfc1dec994eac983e7237ae779d68&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:34.951171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:34.974081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:35.001373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:35.019096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819cdb2-1825-4cd3-a878-1d3366d5f70f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:35.067524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:35.068174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:35.068450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:35.068719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:35.070625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:35.072481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:35.075236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 48/93] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:35.076913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:35.086174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4de79-7cd2-4b2b-b2f3-e1b5b9eef463 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:35.209715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:35.210472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:35.210642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:35.210788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:35.211532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=b23092081c294ccc9f338033bf5ecc16) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:35.211842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:35.212478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1524ea-0e42-4ce6-bdbc-f16a0a6d8a27 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:35.213331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:35.233009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 46/94] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:34 2022] GET /identity/v3/role_assignments?user.id=b23092081c294ccc9f338033bf5ecc16&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:35.234022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:35.259170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:35.259824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:35.260101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:35.260366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] PATH_INFO: `/v3/projects/86980e6b48c14bf6bd7782e185fead09` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:35.261616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] RBAC: Authorizing `identity:get_project(project_id=86980e6b48c14bf6bd7782e185fead09)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:35.263193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:35.266378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 49/95] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:35 2022] GET /identity/v3/projects/86980e6b48c14bf6bd7782e185fead09 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:35.272616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:35.313220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:35.354254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:35.400190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b688df-e390-41c8-8b1d-2f56631baf0d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:35.427533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03caa7-6b4c-4239-a158-b0fd0cc1a0b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:35.441905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:35.442527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:35.442806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:35.443079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:35.443821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=86980e6b48c14bf6bd7782e185fead09, user.id=98bbfc1dec994eac983e7237ae779d68) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:35.444126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:35.445714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cea3a9-42ad-4880-96cd-adcee1278a96 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:35.454032 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 50/96] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:35 2022] GET /identity/v3/role_assignments?user.id=98bbfc1dec994eac983e7237ae779d68&scope.project.id=86980e6b48c14bf6bd7782e185fead09&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:35.515951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:35.516506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:35.516869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:35.517073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:35.517836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] RBAC: Adding query filter params (role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=98bbfc1dec994eac983e7237ae779d68) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:35.518148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:35.519648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b5f69-430e-4f7c-b86b-a6cd8bf74822 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:35.529876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 47/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:35 2022] GET /identity/v3/role_assignments?user.id=98bbfc1dec994eac983e7237ae779d68&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:37.243315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39326-c55c-4205-a31d-5acc349b940f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:37.244017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39326-c55c-4205-a31d-5acc349b940f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:37.244017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39326-c55c-4205-a31d-5acc349b940f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:37.245361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 51/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:37.258897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1ee8-c040-4b78-863a-61728dedd96e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:37.259521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1ee8-c040-4b78-863a-61728dedd96e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:37.259521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1ee8-c040-4b78-863a-61728dedd96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:37.278754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-44ce1ee8-c040-4b78-863a-61728dedd96e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:37.280010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-44ce1ee8-c040-4b78-863a-61728dedd96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:37.374405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:37.717818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39326-c55c-4205-a31d-5acc349b940f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:37.837440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:37.851553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39326-c55c-4205-a31d-5acc349b940f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:37.890514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:37.891147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:37.891430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:37.891696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:37.908103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:37.913418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:37.914251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:37.914979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 52/100] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:37.918099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5baa6f-7b0f-4aa7-8a62-2b99fd576ada None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:37.918407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5baa6f-7b0f-4aa7-8a62-2b99fd576ada None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:37.918654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5baa6f-7b0f-4aa7-8a62-2b99fd576ada None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:37.921114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:37.921236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 49/101] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:37.937277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:37.937574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:37.937831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:37.968713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:37.977352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:38.108186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 50/102] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:38.139685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6f8f-bb01-48a5-8c8e-4fbc936ca03f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:38.191023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:38.191977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.192480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.192993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.193856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:38.194344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:38.195908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff13e7-7d1e-47f5-858d-2461d5779ff7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:38.211956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 53/103] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:38.218260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:38.221355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.306361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0e542-5e41-4e8c-887a-6b3a9dfc7d7d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.307312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0e542-5e41-4e8c-887a-6b3a9dfc7d7d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.307776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0e542-5e41-4e8c-887a-6b3a9dfc7d7d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.309360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 54/104] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:38.317181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ba39-590d-463b-83bd-f60fb8c1bc15 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.317713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ba39-590d-463b-83bd-f60fb8c1bc15 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.318174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ba39-590d-463b-83bd-f60fb8c1bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.349499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-06d2ba39-590d-463b-83bd-f60fb8c1bc15 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:38.351177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-06d2ba39-590d-463b-83bd-f60fb8c1bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:38.357126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.396242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b23ae-8b36-4066-9eb9-20b90f2c4ead None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:38.464482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:38.465146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.465426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.465698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] PATH_INFO: `/v3/users/653459d82fdd49369b87b91a40afd2fb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.473017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 55/105] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:38.479245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adabe1-d5af-4c82-8126-c91596532e3a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.479524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adabe1-d5af-4c82-8126-c91596532e3a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.479792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adabe1-d5af-4c82-8126-c91596532e3a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.481348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 56/106] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:38.489758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.490036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.490307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.502840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=653459d82fdd49369b87b91a40afd2fb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:38.504283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:38.507178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 51/107] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:38 2022] GET /identity/v3/users/653459d82fdd49369b87b91a40afd2fb => generated 289 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:38.513090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:38.527068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:38.528269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:38.586809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.631461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09e9c-4da6-493c-b825-a8547f27a0d6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:38.668330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2220b99-dd61-4992-b383-2c2056884eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:38.668974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2220b99-dd61-4992-b383-2c2056884eee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.669254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2220b99-dd61-4992-b383-2c2056884eee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.669524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2220b99-dd61-4992-b383-2c2056884eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.679435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 57/108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:38.680349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:38.796196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2220b99-dd61-4992-b383-2c2056884eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:38.796196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2220b99-dd61-4992-b383-2c2056884eee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:38.852116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.890700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5091200-94f6-42a1-ab10-b2dcc50cc811 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:38.897614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:38.928144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:38.929146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.929594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.930057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.931335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:38.933036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:38.934829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 58/109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:38.935816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:38.950291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 52/110] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:38.953354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802257a4-c4e1-414d-8dcc-1dc5c55e802d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:38.954134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802257a4-c4e1-414d-8dcc-1dc5c55e802d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:38.954610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802257a4-c4e1-414d-8dcc-1dc5c55e802d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:38.957272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 53/111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:38.958202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802257a4-c4e1-414d-8dcc-1dc5c55e802d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.047266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7539-72b9-44a5-9b7b-848d22f90ad5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.087650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.088331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.088581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.088885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.097082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802257a4-c4e1-414d-8dcc-1dc5c55e802d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.097702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:39.102728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:39.107791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:39.108652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:39.109433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:39.114222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 59/112] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:39.114222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.139788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d380a-f763-4e94-b27b-a2837c85ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.140410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d380a-f763-4e94-b27b-a2837c85ac71 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.140693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d380a-f763-4e94-b27b-a2837c85ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.141010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d380a-f763-4e94-b27b-a2837c85ac71 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.141659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d380a-f763-4e94-b27b-a2837c85ac71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:39.143091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d380a-f763-4e94-b27b-a2837c85ac71 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.170287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 54/113] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:08:38 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:39.171838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.172232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.172581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.200296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:39.201639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:39.211033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:39.234054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb61cd3-1c99-4355-9b1e-c5d9bd4e83de None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.273292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.274033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.274382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.274727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.275913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:39.277421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.279836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 60/114] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:39.280451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.281722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 55/115] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:39.282655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.370640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:39.411111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80ed93-551d-40f8-a23d-1b2bd0bb520a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.411296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc339-22c8-48a4-ae96-a30664a0a899 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.448212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.449247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.449765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.450273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.452891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:39.452891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:39.453287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab31cb-db84-4fa9-9cfe-d132b9dbd24a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.454029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.454868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.455146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.455682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.462769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 56/116] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:39.464122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f9c0-186d-49a5-939d-8ec964bc55b2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.464374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f9c0-186d-49a5-939d-8ec964bc55b2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.464644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f9c0-186d-49a5-939d-8ec964bc55b2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.465993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 57/117] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:39.471727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f9c0-186d-49a5-939d-8ec964bc55b2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.475545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:39.476265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:39.482084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:39.483696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:39.484483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 61/118] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:39.485695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.584202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f9c0-186d-49a5-939d-8ec964bc55b2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.602406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b93ae-6018-4a77-8ec2-9d0711924635 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.620099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.620909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.621039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.621300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.622040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] RBAC: Adding query filter params (role.id=c1eb0543035d40fea48a01f4984475a6, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=653459d82fdd49369b87b91a40afd2fb) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:39.622338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:39.624474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099a3f6-8c46-492a-9102-15e9fe434bce None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.637927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 58/119] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/role_assignments?user.id=653459d82fdd49369b87b91a40afd2fb&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=c1eb0543035d40fea48a01f4984475a6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:39.637927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.637927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.637927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.641201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:39.652597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:39.653737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.654277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:39.654682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.655080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.655436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.656975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:39.659879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.662163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 62/120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:39.663623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.734363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:39.741582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 59/121] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:39.742711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.803157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7130dec-f0d0-49de-8030-116bcddb72f7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.852216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.856994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.858418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.858838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.859910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:39.861425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:39.863263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:39.879932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 63/122] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:39.880891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.881451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e5b8-1b17-4ac5-8867-5d949de774f9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:39.919755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:39.921246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:39.921653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:39.922189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:39.933672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:39.939643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:39.940655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:39.941699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:39.944071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 60/123] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:39.948374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:39.950811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.042229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985145-25e8-4fbc-b5a0-9c0e0a453736 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.054216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.097299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.098202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.098496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.098772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.100099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.102196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.104819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 64/124] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:40.105848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.107919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43406-644f-4932-bfb8-7d7642911bb4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.159097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.159661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.160044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.160325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.162017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.164201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.166914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 61/125] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:39 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:40.168078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.228079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e9319-a64e-42ad-93ef-423c5f93ec60 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.252111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.264765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.265302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.265588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.265862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.266618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:40.266846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.268233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.281152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 65/126] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:40.282113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.289334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a56d1-6539-4d72-8497-d04221eea034 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.317571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.328104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.329002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.329498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.329989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.341671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:40.347446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:40.348257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:40.349048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:40.351026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 62/127] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:40.351928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.391455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148f44-e479-4b5d-b6f0-19fcbc6924df None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.428003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.428821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.429561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.429561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/98bbfc1dec994eac983e7237ae779d68/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.431238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] RBAC: Authorizing `identity:create_grant(project_id=672965d8c3ca41d4986d57425b3d712c, user_id=98bbfc1dec994eac983e7237ae779d68, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.432714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.451889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 66/128] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:40 2022] PUT /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/98bbfc1dec994eac983e7237ae779d68/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:08:40.452797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.467034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5d785-73ed-4153-8b84-d0fe3839482d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.508332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.509003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.510187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.510639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.511108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.512718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.515558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.517885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 63/129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:40.519054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.590866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182ec76-bac8-47e1-abdf-dab2609208cf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.600173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.636660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.637600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.638981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.639419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.640970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.642967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.645556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 67/130] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:40.647732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.713490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71f11-2502-424a-9acd-b71d1e3997f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.755782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.756398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.756680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.756980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.757705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:40.758007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.759601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.769734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 64/131] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:40.770582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.778484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d468-c6dc-4e41-a7a8-40645eccacbe None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.808062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:40.847580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:40.848244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:40.848523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:40.848811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/b23092081c294ccc9f338033bf5ecc16/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:40.852552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] RBAC: Authorizing `identity:create_grant(project_id=672965d8c3ca41d4986d57425b3d712c, user_id=b23092081c294ccc9f338033bf5ecc16, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:40.854667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:40.879293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 68/132] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:40 2022] PUT /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/b23092081c294ccc9f338033bf5ecc16/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:08:40.881835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:40.934239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb94628-6443-4cbd-a88a-af00cfb6ed8b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:40.969960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:41.004283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:41.005004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.005287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.005560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.007404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:41.008918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:41.014551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 65/133] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:41.021740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:41.076209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e8fd5-82d9-4ae6-9b17-abbefef8d65a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:41.147912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:41.148568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.148872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.149454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.151623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:41.154228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:41.159335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 69/134] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:40 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:41.161719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:41.220247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be156de-8f9d-4eeb-a90a-0e1457d68172 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:41.259472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:41.302450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:41.303137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.303427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.303688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/98bbfc1dec994eac983e7237ae779d68/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.305866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=672965d8c3ca41d4986d57425b3d712c, user_id=98bbfc1dec994eac983e7237ae779d68, role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:41.307311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:41.338115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 66/135] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:41 2022] PUT /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/98bbfc1dec994eac983e7237ae779d68/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:08:41.350193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07e6e5-3fb4-4527-8a13-6d55965158b7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:41.393363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254118a-dda5-4f90-8031-121f50d59ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:41.394125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254118a-dda5-4f90-8031-121f50d59ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.394285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254118a-dda5-4f90-8031-121f50d59ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.394559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254118a-dda5-4f90-8031-121f50d59ca4 None admin] PATH_INFO: `/v3/projects/86980e6b48c14bf6bd7782e185fead09` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.395825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254118a-dda5-4f90-8031-121f50d59ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=86980e6b48c14bf6bd7782e185fead09)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:41.397438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254118a-dda5-4f90-8031-121f50d59ca4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:41.399478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 70/136] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:41 2022] GET /identity/v3/projects/86980e6b48c14bf6bd7782e185fead09 => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:41.405183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:41.463090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:41.533003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928a9e-86dd-46f1-bf84-2fb4b26c95f6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:41.572652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c7475-de28-4751-a4c9-3d663a509f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:41.573402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7475-de28-4751-a4c9-3d663a509f52 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:41.573683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7475-de28-4751-a4c9-3d663a509f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:41.573959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7475-de28-4751-a4c9-3d663a509f52 None admin] PATH_INFO: `/v3/projects/86980e6b48c14bf6bd7782e185fead09/users/98bbfc1dec994eac983e7237ae779d68/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:41.576701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c7475-de28-4751-a4c9-3d663a509f52 None admin] RBAC: Authorizing `identity:create_grant(project_id=86980e6b48c14bf6bd7782e185fead09, user_id=98bbfc1dec994eac983e7237ae779d68, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:41.578242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c7475-de28-4751-a4c9-3d663a509f52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:41.597185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 67/137] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:41 2022] PUT /identity/v3/projects/86980e6b48c14bf6bd7782e185fead09/users/98bbfc1dec994eac983e7237ae779d68/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:08:42.127132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3698-0892-4f5e-be52-de3af81d440c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:42.127512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3698-0892-4f5e-be52-de3af81d440c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:42.127840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3698-0892-4f5e-be52-de3af81d440c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:42.129740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 71/138] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:42.134896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fcda0-15de-4a69-b902-cce30f5fb199 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:42.135187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fcda0-15de-4a69-b902-cce30f5fb199 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:42.135467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fcda0-15de-4a69-b902-cce30f5fb199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:42.165860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-936fcda0-15de-4a69-b902-cce30f5fb199 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:42.167071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-936fcda0-15de-4a69-b902-cce30f5fb199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:42.247404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 68/139] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:42.477868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1a4ff-1e16-4c7d-845d-f86adb1d0b55 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:42.478343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1a4ff-1e16-4c7d-845d-f86adb1d0b55 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:42.478343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1a4ff-1e16-4c7d-845d-f86adb1d0b55 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:42.479648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 72/140] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:42.492650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:42.492969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:42.493243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:42.517708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:42.518885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:42.551755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:42.599397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 69/141] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:42.801170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1a4ff-1e16-4c7d-845d-f86adb1d0b55 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:42.927271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1a4ff-1e16-4c7d-845d-f86adb1d0b55 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:42.944230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:42.975476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:42.976165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:42.976500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:42.976769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:42.977961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:42.979472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:42.981111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 73/142] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:42.987183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:43.070702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:43.132512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fe4b6-04a2-491b-9ee2-ca9eb58279b1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:43.195440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:43.196066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.196346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.196617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.197332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:43.198894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:43.248544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae78d6b-8430-473e-8807-77022d6f29b5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:43.250313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 70/143] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:08:42 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:08:43.295314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:43.296157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.296437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.296708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.307969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:43.313940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:43.314781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:43.315530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 74/144] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:43.321277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:43.346060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:43.441152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f6225-ad1d-477f-8106-5eba7e669598 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:43.486642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:43.487295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.487577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.487849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.488544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:43.488870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:43.490274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:43.505605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 71/145] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:43.511346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:43.582937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:43.673464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3512-586c-4e3f-b239-99d1de341891 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:43.715986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56221f29-f78c-42ff-a872-984ea00c5c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:43.717237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56221f29-f78c-42ff-a872-984ea00c5c55 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.717521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56221f29-f78c-42ff-a872-984ea00c5c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.717813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56221f29-f78c-42ff-a872-984ea00c5c55 None admin] PATH_INFO: `/v3/users/653459d82fdd49369b87b91a40afd2fb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.721719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56221f29-f78c-42ff-a872-984ea00c5c55 None admin] RBAC: Authorizing `identity:get_user(user_id=653459d82fdd49369b87b91a40afd2fb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:43.723262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56221f29-f78c-42ff-a872-984ea00c5c55 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:43.725110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 75/146] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:43 2022] GET /identity/v3/users/653459d82fdd49369b87b91a40afd2fb => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:43.730923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:43.842496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:43.848461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a7b61-da37-47a3-9c96-b01eb9db569d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.848736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a7b61-da37-47a3-9c96-b01eb9db569d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.849037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a7b61-da37-47a3-9c96-b01eb9db569d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.850364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 76/147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:43.855627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5929-235f-4080-8e82-2cd24df95f76 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.855912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5929-235f-4080-8e82-2cd24df95f76 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.856180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5929-235f-4080-8e82-2cd24df95f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.870856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf459305-69eb-40d9-be57-6b88a8b9f794 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:43.887281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9aaa5929-235f-4080-8e82-2cd24df95f76 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:43.890215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9aaa5929-235f-4080-8e82-2cd24df95f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:43.935211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:43.936673 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:43.936970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:43.937285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:43.939022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:43.940470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:43.942137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 72/148] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:43 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:43.963656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:44.013480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 77/149] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:44.122859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debcaa6-f95d-4b7c-bb29-d4423003c5a6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:44.171832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89737c56-387a-40e9-a6cc-59942d6761b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:44.172887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737c56-387a-40e9-a6cc-59942d6761b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.173369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737c56-387a-40e9-a6cc-59942d6761b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.173837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737c56-387a-40e9-a6cc-59942d6761b5 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/653459d82fdd49369b87b91a40afd2fb/roles/c1eb0543035d40fea48a01f4984475a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.182475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89737c56-387a-40e9-a6cc-59942d6761b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=672965d8c3ca41d4986d57425b3d712c, user_id=653459d82fdd49369b87b91a40afd2fb, role_id=c1eb0543035d40fea48a01f4984475a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:44.184270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89737c56-387a-40e9-a6cc-59942d6761b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:44.207774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 73/150] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:43 2022] PUT /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c/users/653459d82fdd49369b87b91a40afd2fb/roles/c1eb0543035d40fea48a01f4984475a6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:08:44.306252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9db59-bb63-435d-8f5b-bf0f492cbdeb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.308132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9db59-bb63-435d-8f5b-bf0f492cbdeb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.308132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9db59-bb63-435d-8f5b-bf0f492cbdeb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.308132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 78/151] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:44.314289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.314580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.314858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.336566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:44.337824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:44.341280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:44.431734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9db59-bb63-435d-8f5b-bf0f492cbdeb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:44.432866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 74/152] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:44.484485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:44.566757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9db59-bb63-435d-8f5b-bf0f492cbdeb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:44.610206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d28d2a-a3c5-403e-b727-20040f28b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:44.611234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d28d2a-a3c5-403e-b727-20040f28b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.611707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d28d2a-a3c5-403e-b727-20040f28b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.612172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d28d2a-a3c5-403e-b727-20040f28b9f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.626854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d28d2a-a3c5-403e-b727-20040f28b9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-28d28d2a-a3c5-403e-b727-20040f28b9f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:44.632280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:44.633269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:44.634007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:44.636650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 79/153] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:44.643109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:44.740621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198c531-ca00-41ad-949d-4c241b2b79c8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.741258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198c531-ca00-41ad-949d-4c241b2b79c8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.741749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198c531-ca00-41ad-949d-4c241b2b79c8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.743315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 80/154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:44.749086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.749630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.750094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.777509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:44.779782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:44.799791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510782-8128-4e76-b08e-dfe766657288 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:44.873496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:44.874119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:44.874503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:44.874773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:44.875448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:44.875743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:44.877149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:44.891368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 75/155] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:44.898889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:44.905109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:44.929751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 81/156] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:08:44.930451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:44.993297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.069982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23df84-fbb9-464f-9728-d9901aec8cd7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.098231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcc9af-32b7-4535-aed6-7b557bcec701 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.113985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee24fe4-2ba2-48e3-8618-17b81451bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.114630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee24fe4-2ba2-48e3-8618-17b81451bc79 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.114906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee24fe4-2ba2-48e3-8618-17b81451bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.115182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee24fe4-2ba2-48e3-8618-17b81451bc79 None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.116485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee24fe4-2ba2-48e3-8618-17b81451bc79 None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:45.117976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee24fe4-2ba2-48e3-8618-17b81451bc79 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:45.120763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 76/157] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:44 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:45.124048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3c79c-1084-4189-a56e-6236b1854b82 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.124327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3c79c-1084-4189-a56e-6236b1854b82 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.125755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3c79c-1084-4189-a56e-6236b1854b82 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.127837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 77/158] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:45.128556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3c79c-1084-4189-a56e-6236b1854b82 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.161741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12f908-43f9-40d2-8f75-49119066fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.162355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f908-43f9-40d2-8f75-49119066fb28 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.162662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f908-43f9-40d2-8f75-49119066fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.162887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f908-43f9-40d2-8f75-49119066fb28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.180725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12f908-43f9-40d2-8f75-49119066fb28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2b12f908-43f9-40d2-8f75-49119066fb28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:45.189045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:45.190015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:45.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 82/159] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:45.196073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.196348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.196613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.220081 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:45.221250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.221407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:45.270697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3c79c-1084-4189-a56e-6236b1854b82 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.294189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 83/160] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:45.295417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.313989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.333492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.334125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.334406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.334676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.403069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6012c5-7c83-41f0-8e97-ad2a09d946a5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.438280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:45.439748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:45.443056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.443742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.444082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.444427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.445205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:45.445571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:45.447033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:45.462768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 84/161] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:45.463791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.540663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.568583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124f491-4d7e-4d1a-97a4-17415cdde9a6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.585219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.596274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 78/162] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:45.597173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.605677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.606419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.606863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.607231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.618837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:45.624248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:45.625198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:45.625950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:45.627727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 85/163] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:45.628655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.757267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20078ff0-9378-4b87-9935-aa2b647eb594 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.787634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244357ec-394c-4298-8ee8-edc921d6feb3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:45.837486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.838128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.838403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.838670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] PATH_INFO: `/v3/users/b23092081c294ccc9f338033bf5ecc16` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.841993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] RBAC: Authorizing `identity:get_user(user_id=b23092081c294ccc9f338033bf5ecc16)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:45.843615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:45.843807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:45.844408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:45.844681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:45.845104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:45.845369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 79/164] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/users/b23092081c294ccc9f338033bf5ecc16 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:45.846042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.850461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:45.852180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:45.854089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 86/165] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:45.855044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:45.876068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.911983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:45.990942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade168b-4ff6-4dbf-ab2f-122b22f032ab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.053509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.054138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.054413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.054679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.055354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:46.055656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.057313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.074289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 80/166] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:46.075164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:46.083016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ecafc-b0f0-4997-af36-6b54c82105bd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.144143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.145151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.145636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.146296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.229872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:46.233879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67428-edc8-4702-9458-f500fac335ca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.281907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.283413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.296191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:46.297528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.298169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.298451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.298718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.299470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=98bbfc1dec994eac983e7237ae779d68) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:46.299775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.301280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.308100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 81/167] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/role_assignments?user.id=98bbfc1dec994eac983e7237ae779d68&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:46.318771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:46.477147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7880a40-f7eb-4ecc-99a8-53bf657bd959 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.535480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.536130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.536409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.536679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.561582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:46.565615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 87/168] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:46.566479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:46.567160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:46.568036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:46.568924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 82/169] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:46.571827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:46.618560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:46.702807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009d8e1-868c-40d0-9ddf-e892afed5f91 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.743690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.744326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.744604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.744897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.746896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.748891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.750548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 83/170] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:46.751316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:46.850992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1417-99ea-4cd0-bfcb-668b87792f55 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.862127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:46.867761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:46.878936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d9fc-4b90-47ea-9c9e-cd5714db817e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:46.916376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.917521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.918024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.918498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.919361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:46.919921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.921613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.932876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 84/171] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:46.934009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:46.944495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:46.945171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:46.945447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:46.945716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:46.947299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:46.949131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:46.951218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 88/172] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:46.952443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:47.072247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ccae7-2a35-43df-a351-837c86cd289b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:47.119449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:47.120441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:47.120972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:47.121466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] PATH_INFO: `/v3/users/98bbfc1dec994eac983e7237ae779d68` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:47.123008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] RBAC: Authorizing `identity:get_user(user_id=98bbfc1dec994eac983e7237ae779d68)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:47.125429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:47.127232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 89/173] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/users/98bbfc1dec994eac983e7237ae779d68 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:47.128228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:47.150721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316e6d6-e37f-44c3-ae61-d157806b5572 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:47.181139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:47.219010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:47.219617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:47.219895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:47.220165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:47.220917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=b23092081c294ccc9f338033bf5ecc16) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:47.221223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:47.223104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:47.234535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 85/174] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:46 2022] GET /identity/v3/role_assignments?user.id=b23092081c294ccc9f338033bf5ecc16&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:47.236411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:47.269901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999982-ff26-4d8c-b257-0da9db68115d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:47.286457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:47.354853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:47.355871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:47.356358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:47.356898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:47.455095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:47.457178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:47.484652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f66f3-3f02-4aa9-bc50-135f791d3e15 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:47.538644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:47.580718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:47.581377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:47.581655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:47.581927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:47.609570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 90/175] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:47.615302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:47.758726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:47.760145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:47.778695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076f75-8598-445a-8c27-a1391b147a7e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:47.809892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:47.862769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:47.863455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:47.863710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:47.863986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:47.870262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:47.871813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:47.874297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 91/176] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:47 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:47.885947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:47.915161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:47.996049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 86/177] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:48.002042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:48.114827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e663c-8cc1-4299-8a0e-c4652749fc89 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:48.181779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b411fd-f6c6-4bcc-808f-8674964e81fa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:48.194834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:48.195444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.195722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.195992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.196734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] RBAC: Adding query filter params (role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=98bbfc1dec994eac983e7237ae779d68) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:48.197075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:48.198527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26823faf-84b5-4cf8-8b3a-5f2c16cba080 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:48.209329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 92/178] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:47 2022] GET /identity/v3/role_assignments?user.id=98bbfc1dec994eac983e7237ae779d68&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:48.210551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952bf7-627f-4933-9f0f-8ba949bdc2b8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.210830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952bf7-627f-4933-9f0f-8ba949bdc2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.211098 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01952bf7-627f-4933-9f0f-8ba949bdc2b8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.217714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 93/179] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:48.220054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06ac5b-9559-4349-92c9-d2be1082d86e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.220333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06ac5b-9559-4349-92c9-d2be1082d86e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.220603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06ac5b-9559-4349-92c9-d2be1082d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.220897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:48.250653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fa06ac5b-9559-4349-92c9-d2be1082d86e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:48.252099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fa06ac5b-9559-4349-92c9-d2be1082d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.273514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:48.274170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.274452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.274723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] PATH_INFO: `/v3/projects/86980e6b48c14bf6bd7782e185fead09` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.275904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] RBAC: Authorizing `identity:get_project(project_id=86980e6b48c14bf6bd7782e185fead09)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:48.277415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:48.279742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 87/180] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:48 2022] GET /identity/v3/projects/86980e6b48c14bf6bd7782e185fead09 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:48.286769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:48.407298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 94/181] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:48.505601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba431-f889-49f2-98f6-d2cabd54fa21 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.506351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba431-f889-49f2-98f6-d2cabd54fa21 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.506816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba431-f889-49f2-98f6-d2cabd54fa21 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.509100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 95/182] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:48.515146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436d14-70c3-4fb8-abec-0f430a8b0614 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.515957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436d14-70c3-4fb8-abec-0f430a8b0614 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.516435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436d14-70c3-4fb8-abec-0f430a8b0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.529390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:48.539662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-88436d14-70c3-4fb8-abec-0f430a8b0614 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:48.541901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88436d14-70c3-4fb8-abec-0f430a8b0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.581570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c663b-4ac5-48ff-82bc-387b1f4144aa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:48.630300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 96/183] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:48.640828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f62f-d820-480f-9592-5e465ee78740 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.640828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f62f-d820-480f-9592-5e465ee78740 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.640828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f62f-d820-480f-9592-5e465ee78740 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.640828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 97/184] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:48.647112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373096d2-b76b-4b18-abad-ccfcb82ee0f1 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.647682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373096d2-b76b-4b18-abad-ccfcb82ee0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.647682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373096d2-b76b-4b18-abad-ccfcb82ee0f1 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.649030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 98/185] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:48.649571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce30022-8323-4528-993d-63c691be8577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:48.650013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.650285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.650552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.650762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30022-8323-4528-993d-63c691be8577 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.651160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30022-8323-4528-993d-63c691be8577 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.651568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce30022-8323-4528-993d-63c691be8577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.652425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30022-8323-4528-993d-63c691be8577 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=86980e6b48c14bf6bd7782e185fead09, user.id=98bbfc1dec994eac983e7237ae779d68) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:48.653002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30022-8323-4528-993d-63c691be8577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:48.658864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce30022-8323-4528-993d-63c691be8577 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:48.666575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 88/186] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:48 2022] GET /identity/v3/role_assignments?user.id=98bbfc1dec994eac983e7237ae779d68&scope.project.id=86980e6b48c14bf6bd7782e185fead09&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:48.668007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.668446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.668894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:48.679625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:48.688882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.690451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:48.691940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:48.751457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:48.777935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 89/187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:48.779096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:48.926330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 99/188] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:48.943695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7772-6a68-4326-bb94-dfadb0419b57 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:48.996931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:48.997556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:48.998022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:48.998298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.015405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:49.020319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:49.021228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:49.022078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:49.029545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.029932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 90/189] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:49.036658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.094176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.156591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.199630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae56d77-67f1-4bc3-a5c8-be799230bb44 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.200156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ab319-fbf9-4d33-9c2b-4dbc22297711 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.237975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.239002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.239341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.239681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.240418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:49.240722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.242133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.242256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.242760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.243033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.243295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.244909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.246329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.249451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 100/190] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:49.250144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.253157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 91/191] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:49.253884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.348854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07485-1125-4a60-8729-d991fea326ee None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.351677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36718bd-ebc8-442e-a841-4fda8baacbc6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.353204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.378929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.384108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.384895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.385174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.385440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.386169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.386790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.387071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.387344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.395844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:49.397983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:49.400724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:49.401793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 101/192] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:49.402575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:49.403304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:49.404119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:49.404939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:49.406531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 92/193] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:49.407534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.505321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e39b8-0c6f-4eeb-8fb7-6d666c1d57c4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.507687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be8a71-a2a7-47bd-b229-1144757c89b9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.538499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.539099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.539376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.539645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.539926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.540288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.540544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.540844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.541115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] PATH_INFO: `/v3/users/03e50d48720e437fb1757fc1b3434afb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.541806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.555128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] RBAC: Authorizing `identity:get_user(user_id=03e50d48720e437fb1757fc1b3434afb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.556707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.558452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 93/194] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/users/03e50d48720e437fb1757fc1b3434afb => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:49.559209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.576822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 102/195] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:08:49 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:49.576822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.585063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.630983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.682380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbdcc3-57ff-4852-81a5-e87b8574d830 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.692905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895debcf-392c-4c3a-b2fa-d268f65240e6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.719458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.720078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.720363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.720635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.721361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:49.721662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.723068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.731836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 94/196] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:49.733287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.737940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.738643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.738988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.738988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.740806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:49.740806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.742029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.750585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 103/197] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:49.751311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.840902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.870804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671e8b-2bea-436b-85cf-6a9cfcffd534 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.891697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b07c1-c38d-46e4-bea8-f416ccf4adf6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:49.904537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:49.911581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.912198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.912475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.912746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.938143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:49.938837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:49.939047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:49.939295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] PATH_INFO: `/v3/users/653459d82fdd49369b87b91a40afd2fb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:49.941256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] RBAC: Authorizing `identity:get_user(user_id=653459d82fdd49369b87b91a40afd2fb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.942705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:49.944379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 104/198] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/users/653459d82fdd49369b87b91a40afd2fb => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:49.945246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:49.993633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:49.995390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.066736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267a339-ae55-4f8c-b30f-8462fe5fb18a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.082761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.103950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 95/199] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:50.104884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.113528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.114168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.114447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.114713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] PATH_INFO: `/v3/users/03e50d48720e437fb1757fc1b3434afb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.117856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] RBAC: Authorizing `identity:get_user(user_id=03e50d48720e437fb1757fc1b3434afb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.120240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.123075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 105/200] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:49 2022] GET /identity/v3/users/03e50d48720e437fb1757fc1b3434afb => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:50.124142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.184107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.225296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cc85d-b650-49f2-add1-3ddb7434e0ca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.258580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e54d9-9a75-44b5-8d36-ea1dd0f8b9fd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.260674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.261276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.261595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.261873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.304199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.305502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.305824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.306160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.309155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.310984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.318000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 106/201] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:50.318000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.327642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.358920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.360450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.434037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17364372-d3fa-4458-9ee7-fca58efc8bf2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.453020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.475930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 96/202] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:50.477141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.477580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.478188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.478463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.478729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.550289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.551769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.564943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.589164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae999b9c-df6c-4307-8d62-ec87f8d1e592 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.626966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.627735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.628090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.628435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.629275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=03e50d48720e437fb1757fc1b3434afb) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:50.629655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.631420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.637564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 97/203] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/role_assignments?user.id=03e50d48720e437fb1757fc1b3434afb&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:50.639251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.664965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 107/204] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:50.666427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.682775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.756674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe110b6-9335-4898-b691-5361b3b8aca2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.773345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01539d-2a6e-462a-9137-e5c2ebd78133 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.805787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.806861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.807301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.807728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.809499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.810659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.811407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.811572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.811866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.812247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.813565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.814269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 98/205] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:50.815387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.822070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 108/206] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:50.823303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.823410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:50.845320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.911594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:50.945109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e339c-5b96-463e-8ce3-9482d916f813 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.959632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb95b-6bbf-47e3-9dce-a0eeff9da167 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:50.983972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:50.984964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:50.985495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:50.985960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:50.986902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] RBAC: Adding query filter params (role.id=c1eb0543035d40fea48a01f4984475a6, scope.project.id=672965d8c3ca41d4986d57425b3d712c, user.id=653459d82fdd49369b87b91a40afd2fb) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:50.987410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:50.989243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576597b-5044-4dc0-b5ba-4dc6a9a74a2b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:50.996734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 99/207] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/role_assignments?user.id=653459d82fdd49369b87b91a40afd2fb&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=c1eb0543035d40fea48a01f4984475a6 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:51.008357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:51.008357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:51.008357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:51.008357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:51.008806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] RBAC: Adding query filter params (role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=03e50d48720e437fb1757fc1b3434afb) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:51.008806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:51.010275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f234-a393-4e94-8939-a640e8c94600 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:51.017238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 109/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:50 2022] GET /identity/v3/role_assignments?user.id=03e50d48720e437fb1757fc1b3434afb&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:52.031430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f5ab-b9bc-4e12-b841-306143585a68 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.032453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f5ab-b9bc-4e12-b841-306143585a68 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.032999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f5ab-b9bc-4e12-b841-306143585a68 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.034583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 100/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:52.040255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc11b-aeb9-4633-988d-06de2a9bdd69 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.041110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc11b-aeb9-4633-988d-06de2a9bdd69 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.041598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc11b-aeb9-4633-988d-06de2a9bdd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.060985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2afcc11b-aeb9-4633-988d-06de2a9bdd69 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:52.062457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2afcc11b-aeb9-4633-988d-06de2a9bdd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:52.137373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 110/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:52.238581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386c35-c65d-4a54-b3ac-134d28b0c4e6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.238928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386c35-c65d-4a54-b3ac-134d28b0c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.239141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386c35-c65d-4a54-b3ac-134d28b0c4e6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.240649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 101/211] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:52.246171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.246666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.247148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.266527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:52.267981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:52.342333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 111/212] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:52.444065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386c35-c65d-4a54-b3ac-134d28b0c4e6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:52.526295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:52.549693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386c35-c65d-4a54-b3ac-134d28b0c4e6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:52.584637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:52.585365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.585648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.585925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.596924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:52.602272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:52.603152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:52.603921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 102/213] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:52.611314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:52.620393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:52.622596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:52.737348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451b906-c455-4b1f-b17f-d32e4431773a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:52.737957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8aed4-e96f-4b88-b7ff-e88fa5cad7c8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:52.775655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:52.776711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.777348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.777841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.779370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:52.781023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:52.787437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:52.787437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.787437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.787710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.787933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 103/214] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:52.788329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:52.788521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:52.789502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:52.789880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:52.803315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 112/215] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:52.805399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:52.811436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:52.886277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:52.924361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee557a-073e-425c-a482-e6ed59bdc1ab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:52.929858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd41c5-bdbc-49b1-bbe5-78e712199273 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:52.966914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:52.968101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.968581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.969117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] PATH_INFO: `/v3/users/14b30b284b93460981faf20d60e67790` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.970089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa91d63-7226-4be3-bb5f-10ceddcd9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:52.970729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa91d63-7226-4be3-bb5f-10ceddcd9b22 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:52.971062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa91d63-7226-4be3-bb5f-10ceddcd9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:52.971341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa91d63-7226-4be3-bb5f-10ceddcd9b22 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:52.972019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa91d63-7226-4be3-bb5f-10ceddcd9b22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:52.974755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa91d63-7226-4be3-bb5f-10ceddcd9b22 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:52.987840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] RBAC: Authorizing `identity:get_user(user_id=14b30b284b93460981faf20d60e67790)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:52.990262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:52.992481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 113/216] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:52 2022] GET /identity/v3/users/14b30b284b93460981faf20d60e67790 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:52.999484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:53.007111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 104/217] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:08:52 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:53.103052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fde26e-9aa0-475b-8b9f-4c6fd4f70ce7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.103701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fde26e-9aa0-475b-8b9f-4c6fd4f70ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.103701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fde26e-9aa0-475b-8b9f-4c6fd4f70ce7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.105524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 105/218] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:08:53.113842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa331ed-fdee-45b4-8d23-53b9a2a917dd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.114359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa331ed-fdee-45b4-8d23-53b9a2a917dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.114669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa331ed-fdee-45b4-8d23-53b9a2a917dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.125326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738d7f-42ca-4665-81be-eaef65b2e0ee None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:53.141151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6fa331ed-fdee-45b4-8d23-53b9a2a917dd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:53.143429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6fa331ed-fdee-45b4-8d23-53b9a2a917dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:53.157495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:53.168625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:53.169348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.170220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.170506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.226552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:53.243146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 106/219] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:53.262967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:53.265049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:53.360678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7326d2-99b9-44fa-b2a2-329ed475e8af None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.361010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7326d2-99b9-44fa-b2a2-329ed475e8af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.361257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7326d2-99b9-44fa-b2a2-329ed475e8af None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.362923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 107/220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:53.368530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.368530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.368530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.377162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 114/221] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:53.384120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:53.402072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:53.403189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:53.415698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:53.496161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 108/222] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:53.501150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99358923-c39a-4467-8284-4ee5727f5138 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:53.537162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:53.537789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.538063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.538333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.539453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:53.540969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:53.542614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 115/223] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:53 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:53.548653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:53.565093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:53.669430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83476be6-b8b5-4d8b-ad62-ca5658f37dfb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:53.694008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:53.708053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:53.708964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.709500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.709942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.710911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=14b30b284b93460981faf20d60e67790) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:53.711394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:53.713028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:53.723744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 109/224] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:53 2022] GET /identity/v3/role_assignments?user.id=14b30b284b93460981faf20d60e67790&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:53.735196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:53.749224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef201d76-9c37-4ee6-ad2e-376f521b1411 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:53.812280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:53.812965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:53.813249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:53.813515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:53.837540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:53.842748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:53.843648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:53.845001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 116/225] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:53.846098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:53.849553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:53.999785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71a7c-73f5-464c-bfc8-0cb758b3776c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.022188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eff90-5304-4767-9d95-10ed9188a52b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.041113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.041743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.042024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.042293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.063649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:54.069287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:54.070163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:08:54.071311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 110/226] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:08:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:54.079387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.083397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.084015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.084290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.084557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.086358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:54.086670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.089929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.107556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 117/227] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:54.122089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.138751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:54.154643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:54.208110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fddcc-d8a5-4fc0-8bac-d9936b90b887 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.242503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.243120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.243459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.243735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.244455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:54.244762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.246564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.256968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 111/228] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:08:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:54.262961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.351741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a697c-d86c-4e34-8006-fd5fc44fe29c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.380043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387a02-4615-450f-a0d0-70db214931f0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.395102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:54.425369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.426005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.426281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.426551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] PATH_INFO: `/v3/users/03e50d48720e437fb1757fc1b3434afb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.428258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] RBAC: Authorizing `identity:get_user(user_id=03e50d48720e437fb1757fc1b3434afb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.429739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.432893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 118/229] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:54 2022] GET /identity/v3/users/03e50d48720e437fb1757fc1b3434afb => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:54.441409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.446158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.447033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.447391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.447666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] PATH_INFO: `/v3/users/03e50d48720e437fb1757fc1b3434afb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.450032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] RBAC: Authorizing `identity:get_user(user_id=03e50d48720e437fb1757fc1b3434afb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.456848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.459566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 112/230] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:54 2022] GET /identity/v3/users/03e50d48720e437fb1757fc1b3434afb => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:54.464147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.565560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:54.583837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e138a5-0a5b-4197-b9c4-fbd432d06f27 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.604733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb8498-d893-430b-9952-1ba306f15c68 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.619390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.620131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.620305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.620557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.621721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.623373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.625219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 119/231] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:54 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:54.630831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.652681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.653354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.653691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.654171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.656251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.660764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.662569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 113/232] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:54 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:54.668723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:54.749166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:54.802750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776285a-1e9e-4efc-a3b1-cbe7727d69a1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.842848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330935c1-3462-4579-a752-20d87ae69418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.843435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330935c1-3462-4579-a752-20d87ae69418 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.843712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330935c1-3462-4579-a752-20d87ae69418 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.843978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330935c1-3462-4579-a752-20d87ae69418 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76/users/03e50d48720e437fb1757fc1b3434afb/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.846948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330935c1-3462-4579-a752-20d87ae69418 None admin] RBAC: Authorizing `identity:create_grant(project_id=39ed3440aded4079a334c8f86a922b76, user_id=03e50d48720e437fb1757fc1b3434afb, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.848399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330935c1-3462-4579-a752-20d87ae69418 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.862587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f8a8f-2879-451b-8253-e700ae0fb7a8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:54.872054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 120/233] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:54 2022] PUT /identity/v3/projects/39ed3440aded4079a334c8f86a922b76/users/03e50d48720e437fb1757fc1b3434afb/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:08:54.909469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d093c-6989-4a72-b55f-a10822bf27e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:54.910200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d093c-6989-4a72-b55f-a10822bf27e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:54.910522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d093c-6989-4a72-b55f-a10822bf27e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:54.910798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d093c-6989-4a72-b55f-a10822bf27e2 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76/users/03e50d48720e437fb1757fc1b3434afb/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:54.913050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d093c-6989-4a72-b55f-a10822bf27e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=39ed3440aded4079a334c8f86a922b76, user_id=03e50d48720e437fb1757fc1b3434afb, role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:54.914573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d093c-6989-4a72-b55f-a10822bf27e2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:54.931920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:54 2022] PUT /identity/v3/projects/39ed3440aded4079a334c8f86a922b76/users/03e50d48720e437fb1757fc1b3434afb/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:08:55.689942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711d17-5645-445c-bc6a-fc7a034155ed None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:55.690468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711d17-5645-445c-bc6a-fc7a034155ed None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:55.690628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711d17-5645-445c-bc6a-fc7a034155ed None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:55.692058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:55.698077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36432-6bd4-45c8-95ce-32b128aa9150 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:55.698474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36432-6bd4-45c8-95ce-32b128aa9150 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:55.698615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c36432-6bd4-45c8-95ce-32b128aa9150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:55.722622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83c36432-6bd4-45c8-95ce-32b128aa9150 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:55.723817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83c36432-6bd4-45c8-95ce-32b128aa9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:55.814466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 115/236] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:56.137154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be711d17-5645-445c-bc6a-fc7a034155ed None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:56.153405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:56.257867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4dff1-06d7-41be-807b-a3f105aa0bd0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.258188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4dff1-06d7-41be-807b-a3f105aa0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.258399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4dff1-06d7-41be-807b-a3f105aa0bd0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.261229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 116/237] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:56.265462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.265739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.266006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.280681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be711d17-5645-445c-bc6a-fc7a034155ed None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:56.297612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:56.298817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:56.343439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:56.344389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d561a6-0f0e-489c-9cf7-e342e849dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:56.345057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d561a6-0f0e-489c-9cf7-e342e849dbda None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.345336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d561a6-0f0e-489c-9cf7-e342e849dbda None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.345665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d561a6-0f0e-489c-9cf7-e342e849dbda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.358657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d561a6-0f0e-489c-9cf7-e342e849dbda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-21d561a6-0f0e-489c-9cf7-e342e849dbda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:56.364613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:56.365590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:56.366371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 122/238] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:56.367004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c7c3-33b4-4f34-9e8e-26546c340738 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.367539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c7c3-33b4-4f34-9e8e-26546c340738 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.367539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c7c3-33b4-4f34-9e8e-26546c340738 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.372809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 123/239] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:56.374010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.374291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.374556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.392979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:56.394094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:56.399230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 117/240] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:56.405631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:56.514135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 124/241] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:56.567399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0eefc-8c05-4f45-8f74-f4ed484f25d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:56.613723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:56.614330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.614606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.614874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.615531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:56.615827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:56.617280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:56.628748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 118/242] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:56.634743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:56.637294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:56.756739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5413f2-eb7f-41d1-b3d0-4cf305fba101 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:56.805314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:56.805314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:56.805314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:56.805314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] PATH_INFO: `/v3/users/15c6194c163f45748205a891327ff33e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:56.817173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] RBAC: Authorizing `identity:get_user(user_id=15c6194c163f45748205a891327ff33e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:56.818691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:56.820506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 125/243] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:56 2022] GET /identity/v3/users/15c6194c163f45748205a891327ff33e => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:56.826548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:56.837468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:56.893950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:56.930175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:56.987838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36254-1d9e-4b5a-952b-24d0214aae63 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.000851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f70a4-8026-4082-8137-08d8dd1cdcbd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.034618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.035153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.035431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.035700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.044829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.044829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.044829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.044829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.045280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.046150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.047719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 126/244] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:08:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:57.052791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.115104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.116556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.144884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.165144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19cd5-b4a1-4def-8282-660fb7d01991 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.193892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.203957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.204817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.205239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.205916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.217514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:57.222593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:57.223765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:08:57.224737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:57.226391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 119/245] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:57.226736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 127/246] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:57.231962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.232479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.336835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25e9ee-8b6c-44cd-8fc4-1f647f9bee8d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.338153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6883a5-b67b-4070-bc18-9909bd4fecb1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.366670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.378081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.378801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.379091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.379422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.380190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.381022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.381784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.381932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.382338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.382748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.383594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:57.384040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.385610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.395853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 128/247] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:57.397202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.407853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 120/248] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:08:57 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:08:57.418352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.453462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.512879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ca036-b8ee-4d86-9ecb-a7f2b62ca735 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.553269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06a05c-4508-4dad-ab00-657121546a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.553930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06a05c-4508-4dad-ab00-657121546a16 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.554208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06a05c-4508-4dad-ab00-657121546a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.554484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06a05c-4508-4dad-ab00-657121546a16 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.555778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06a05c-4508-4dad-ab00-657121546a16 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.557294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06a05c-4508-4dad-ab00-657121546a16 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.559206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 129/249] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:57.565933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b8d1-ecb4-4ce5-a292-8242ddb283d8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.566333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b8d1-ecb4-4ce5-a292-8242ddb283d8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.566615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b8d1-ecb4-4ce5-a292-8242ddb283d8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.572755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 130/250] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:57.572755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b8d1-ecb4-4ce5-a292-8242ddb283d8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.593202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf1c9c-2852-4e10-8d30-75985692ecfe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.644639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d303dac-7fd7-4787-920c-e0bb65f4b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.645621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303dac-7fd7-4787-920c-e0bb65f4b12c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.646085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303dac-7fd7-4787-920c-e0bb65f4b12c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.646558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303dac-7fd7-4787-920c-e0bb65f4b12c None admin] PATH_INFO: `/v3/users/14b30b284b93460981faf20d60e67790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.648172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d303dac-7fd7-4787-920c-e0bb65f4b12c None admin] RBAC: Authorizing `identity:get_user(user_id=14b30b284b93460981faf20d60e67790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.649880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d303dac-7fd7-4787-920c-e0bb65f4b12c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.651653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 121/251] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/users/14b30b284b93460981faf20d60e67790 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:57.652604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e40a7-1ea6-46d6-a4bb-f33733c2ba01 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.653664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e40a7-1ea6-46d6-a4bb-f33733c2ba01 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.653997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e40a7-1ea6-46d6-a4bb-f33733c2ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.672877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-748e40a7-1ea6-46d6-a4bb-f33733c2ba01 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:57.674093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-748e40a7-1ea6-46d6-a4bb-f33733c2ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:57.694070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b8d1-ecb4-4ce5-a292-8242ddb283d8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.714280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.733971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:57.737190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.738805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.738805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.738805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.739060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] RBAC: Adding query filter params (role.id=c1eb0543035d40fea48a01f4984475a6, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=15c6194c163f45748205a891327ff33e) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:57.739349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.740834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.747641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 131/252] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/role_assignments?user.id=15c6194c163f45748205a891327ff33e&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=c1eb0543035d40fea48a01f4984475a6 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:57.748856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:57.759479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 122/253] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:57.770313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e03e8-d473-4ce8-98df-cde432c2913e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.770639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e03e8-d473-4ce8-98df-cde432c2913e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.770868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e03e8-d473-4ce8-98df-cde432c2913e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.772831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 123/254] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:08:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:08:57.778277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.778599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.779605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.809765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:08:57.811724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:08:57.896945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 124/255] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:08:57.921189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05859c7-ce9e-4d65-b2a5-ed96911d819e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:57.970450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:57.971078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:57.971348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:57.971612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:57.972740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:57.974192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:57.975813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 132/256] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:57 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:57.981820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.088685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd84ca7-736a-4fa5-a2e2-8990b2052a33 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.100577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:58.110267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.130747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.131738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.132234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.132702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76/users/14b30b284b93460981faf20d60e67790/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.134810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] RBAC: Authorizing `identity:create_grant(project_id=39ed3440aded4079a334c8f86a922b76, user_id=14b30b284b93460981faf20d60e67790, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:58.136458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:58.165089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 125/257] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:08:57 2022] PUT /identity/v3/projects/39ed3440aded4079a334c8f86a922b76/users/14b30b284b93460981faf20d60e67790/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:08:58.172702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:58.234391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc54ea-e148-4da1-8551-b532a4ffccbe None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.275938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.277104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.277604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.278105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.291615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:58.297547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:58.298544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:58.299301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 133/258] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:08:58.306102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.344178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.474656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11661563-c423-4cb5-8282-d1721cc4b1d3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.500727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:58.512577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.514213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.514474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.514737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.528053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:08:58.534010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:08:58.536170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:08:58.538174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 134/259] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:08:58.540896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c59d-21ed-4ce8-88b0-908b960d8338 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.544858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.641516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.642143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.642425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.642695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.643370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:58.643666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:58.645059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:58.656636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ca17-9b22-4899-881d-3095decce3ba None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.662779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 126/260] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:58.681850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.729610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.730207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.730489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.730815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.731500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:08:58.732054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:58.733738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:58.743536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:58.751358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 135/261] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:58.758878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.813122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:58.886914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85618-9212-4647-9d25-86e31c9e4198 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.925558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e132b-875f-4068-9dfe-1b7c92ffbc39 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:58.941603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.942266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.942541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.942819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] PATH_INFO: `/v3/users/03e50d48720e437fb1757fc1b3434afb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.949715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] RBAC: Authorizing `identity:get_user(user_id=03e50d48720e437fb1757fc1b3434afb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:58.951839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:58.953864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 127/262] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/users/03e50d48720e437fb1757fc1b3434afb => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:58.968975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:58.970229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:58.970865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:58.971230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:58.971498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] PATH_INFO: `/v3/users/03e50d48720e437fb1757fc1b3434afb` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:58.972942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=03e50d48720e437fb1757fc1b3434afb)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:58.974393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:58.976159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 136/263] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/users/03e50d48720e437fb1757fc1b3434afb => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:08:58.981550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:59.089257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92533c-24be-45a5-a750-1d9cc19d3fb2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:59.093207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:59.134441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:59.135307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:59.135587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:59.135858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:59.145830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:59.151310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f433324-1dcc-4ddd-b42a-01d39c7b8c66 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:59.208711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:59.209815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:59.209815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:59.209815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:59.272358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:59.277549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:59.346584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:59.348124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:59.499645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:59.502238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:59.505907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 128/264] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:59.513119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 137/265] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:08:59.514351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:59.516559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:59.694912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c01e-5cab-4871-96ef-e213cf92d782 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:59.704132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358c7f-f6a1-4106-bbcb-b4c0569e69f0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:59.757085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:59.758071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:59.758344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:59.758607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:59.765697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:59.767462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:59.769085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 138/266] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:59 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:59.774476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:59.774785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:59.775214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:08:59.775527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:08:59.775771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:08:59.776930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:08:59.778357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:08:59.780589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 129/267] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:08:59 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:08:59.787425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:08:59.910930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:59.950115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068553ec-85b6-4820-8cd3-f76bd30498ce None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:08:59.954870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:59.996422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:08:59.997420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.001090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.001506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.002371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] RBAC: Adding query filter params (role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=03e50d48720e437fb1757fc1b3434afb) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:00.002813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:00.004397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ce43-e46b-42ce-89bc-54ee9ebb8951 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:00.016600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 139/268] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:59 2022] GET /identity/v3/role_assignments?user.id=03e50d48720e437fb1757fc1b3434afb&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:00.023942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d0cda-fa93-4802-aa80-bfe3609b11cd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:00.064399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:00.065343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.065758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.066162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.067025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=03e50d48720e437fb1757fc1b3434afb) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:00.067466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:00.069078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8e7e-3a11-4090-8de1-bf0b72758325 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:00.076305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 130/269] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:08:59 2022] GET /identity/v3/role_assignments?user.id=03e50d48720e437fb1757fc1b3434afb&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:00.681528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955cc31-b2ca-4f7e-b66a-5001dacdf1ae None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.682041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955cc31-b2ca-4f7e-b66a-5001dacdf1ae None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.682452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955cc31-b2ca-4f7e-b66a-5001dacdf1ae None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.684012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 140/270] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:00.689701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b372-0e78-44e0-ad17-69c26fc0c0f5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.690233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b372-0e78-44e0-ad17-69c26fc0c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.690693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100b372-0e78-44e0-ad17-69c26fc0c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.710286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3100b372-0e78-44e0-ad17-69c26fc0c0f5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:00.711791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3100b372-0e78-44e0-ad17-69c26fc0c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:00.793397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 131/271] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:00.946226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd42d-ab05-4b42-bb39-7408b55f8897 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.946543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd42d-ab05-4b42-bb39-7408b55f8897 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.946710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd42d-ab05-4b42-bb39-7408b55f8897 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.948092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 141/272] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:00.954570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:00.955092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:00.956235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:00.975210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:00.976712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:01.018587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060d0a-b4fb-43ad-875b-6cf049e5b594 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.019526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060d0a-b4fb-43ad-875b-6cf049e5b594 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.020009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060d0a-b4fb-43ad-875b-6cf049e5b594 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.022005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 142/273] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:01.029043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.029718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.030463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.041098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.052811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 132/274] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:01.060605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:01.062118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:01.080545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.149948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 143/275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:01.187995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240b4d-02d9-4333-8d12-6a2050427dc7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.224056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22349846-c448-422e-9246-7ad7dbc7a344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.224609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349846-c448-422e-9246-7ad7dbc7a344 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.224916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349846-c448-422e-9246-7ad7dbc7a344 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.225188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22349846-c448-422e-9246-7ad7dbc7a344 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.239123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22349846-c448-422e-9246-7ad7dbc7a344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-22349846-c448-422e-9246-7ad7dbc7a344 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:01.244467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:01.245663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:01.246569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 133/276] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:01.254292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.319431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.360898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8fd7a-153a-4276-bb5a-2d876c06cd09 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.361303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8fd7a-153a-4276-bb5a-2d876c06cd09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.361696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8fd7a-153a-4276-bb5a-2d876c06cd09 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.363309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6218-4996-4531-b5d6-7cbde980907f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.363956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 134/277] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:09:01.369468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.369837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.370213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.392389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:01.394082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:01.401170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.401778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.402047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.402309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.402995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:01.403289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.405625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.413853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 144/278] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:01.414546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.448392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.470530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 135/279] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:01.471359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.520253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0746b-0210-4a79-b30f-73e2b012cb12 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.545696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.557684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.558698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.558974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.559240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.570650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:01.576834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:01.577694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:01.578472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 145/280] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:01.579110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.585914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9986a-dbe8-48d0-a34f-934038ee2ead None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.621406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.622808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.623225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.623674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] PATH_INFO: `/v3/users/15c6194c163f45748205a891327ff33e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.624844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] RBAC: Authorizing `identity:get_user(user_id=15c6194c163f45748205a891327ff33e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.626264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.627811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 136/281] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/users/15c6194c163f45748205a891327ff33e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:01.633355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.682795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95703da-b7a0-462f-bc1d-be7a8e1200f6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.686833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.718508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.719122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.719393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.719656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.720745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.722213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.724822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 146/282] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:01.724822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.743331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354edc-3c62-4581-97ef-7b00e1a223c7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.777091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.777619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.778098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.778202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.778321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.778932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:01.779257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.780674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.788676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 137/283] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:01.789460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.828971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e9c53-9e8f-4356-8fa3-3166687955e7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.861419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f235b-1553-4098-9972-b683404b47ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.862038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f235b-1553-4098-9972-b683404b47ea None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.862311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f235b-1553-4098-9972-b683404b47ea None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.862576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f235b-1553-4098-9972-b683404b47ea None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.863683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f235b-1553-4098-9972-b683404b47ea None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.865143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f235b-1553-4098-9972-b683404b47ea None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.866767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 147/284] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:01.867508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f235b-1553-4098-9972-b683404b47ea None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.893868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c45db-5ce0-4182-a4be-50818866a035 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:01.906571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:01.930628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:01.931228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:01.931502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:01.931759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:01.932393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:01.933860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:01.956048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 138/285] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:01 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:01.956871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:01.977857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f235b-1553-4098-9972-b683404b47ea None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.005365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:02.022387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.023132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.023410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.023683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.035995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:02.041771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:02.042760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:02.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 148/286] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:02.050229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:02.090189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4fb0-9b99-4097-baea-31bd88221473 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.135882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.136529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.137318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.137318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] PATH_INFO: `/v3/users/c8f1276bff184387beba230c86917445` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.154667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=c8f1276bff184387beba230c86917445)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:02.156151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:02.158287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 139/287] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:01 2022] GET /identity/v3/users/c8f1276bff184387beba230c86917445 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:02.163949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:02.170236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139c018-daa5-4899-9dcb-7c00f0c8f5da None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.201389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:02.222542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.223594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.223870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.224171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76/users/15c6194c163f45748205a891327ff33e/roles/c1eb0543035d40fea48a01f4984475a6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.227245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] RBAC: Authorizing `identity:create_grant(project_id=39ed3440aded4079a334c8f86a922b76, user_id=15c6194c163f45748205a891327ff33e, role_id=c1eb0543035d40fea48a01f4984475a6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:02.229457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:02.255176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 149/288] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:09:02 2022] PUT /identity/v3/projects/39ed3440aded4079a334c8f86a922b76/users/15c6194c163f45748205a891327ff33e/roles/c1eb0543035d40fea48a01f4984475a6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:02.255728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:02.315579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8558-0a55-4cf3-95fe-7fce9a7a1cd4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.338428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:02.380215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.381427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.381710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.381973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.382684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:02.382997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:02.384399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:02.395401 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 140/289] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:02.401972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:02.425389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d2335-735d-4b07-b210-a58b005a4599 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.482981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.484304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.485140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.486168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.488201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, user.id=c8f1276bff184387beba230c86917445, scope.system=all) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:02.489315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:02.493406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:02.502126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 150/290] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 28 12:09:02 2022] GET /identity/v3/role_assignments?user.id=c8f1276bff184387beba230c86917445&scope.system=all&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:02.523401 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:02.541210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498038-427a-4b7b-96f0-e0cc4ceb7c47 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.595695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.596264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.596542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.596830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] PATH_INFO: `/v3/users/14b30b284b93460981faf20d60e67790` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.598045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] RBAC: Authorizing `identity:get_user(user_id=14b30b284b93460981faf20d60e67790)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:02.599511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:02.602212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 141/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:02 2022] GET /identity/v3/users/14b30b284b93460981faf20d60e67790 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:02.607329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:02.787595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c40b0-6af1-422d-b9cf-a87efb4603d8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:02.791200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:02.838032 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:02.838648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:02.838981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:02.839385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:02.944962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:02.946879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:03.082634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 151/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:03.087917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:03.237760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac38ea-7a74-4de2-ad5b-3f5cbd9bab45 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:03.271812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cceac2-6750-4daa-97e5-813e28370cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:03.272444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cceac2-6750-4daa-97e5-813e28370cdb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:03.272721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cceac2-6750-4daa-97e5-813e28370cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:03.273017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cceac2-6750-4daa-97e5-813e28370cdb None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:03.274141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cceac2-6750-4daa-97e5-813e28370cdb None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:03.275578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cceac2-6750-4daa-97e5-813e28370cdb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:03.277546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 142/293] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:03 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:03.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:03.289880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:03.415705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1fa3-dca0-404c-8dc9-8030fac7d4e2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:03.452817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:03.453442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:03.453721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:03.454046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:03.454840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=14b30b284b93460981faf20d60e67790) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:03.455146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:03.457005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfce4b-5320-4757-97c3-f8d8fbe33754 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:03.464110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 152/294] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:03 2022] GET /identity/v3/role_assignments?user.id=14b30b284b93460981faf20d60e67790&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:04.848862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2103e-026c-48c5-a5aa-28c494326303 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.849841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2103e-026c-48c5-a5aa-28c494326303 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.850311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2103e-026c-48c5-a5aa-28c494326303 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.852117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 143/295] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:04.857399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377ef8e-362c-4a8c-b289-be3b9eb22884 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.858253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377ef8e-362c-4a8c-b289-be3b9eb22884 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.858738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377ef8e-362c-4a8c-b289-be3b9eb22884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.876867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc626-625b-4459-8e7d-c17cca0b9809 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.877511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc626-625b-4459-8e7d-c17cca0b9809 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.877987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc626-625b-4459-8e7d-c17cca0b9809 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.879481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7377ef8e-362c-4a8c-b289-be3b9eb22884 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:04.879860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 144/296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:04.884871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7377ef8e-362c-4a8c-b289-be3b9eb22884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:04.887519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa30b-5b26-4df0-a29d-9d081bff6b4a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.888831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa30b-5b26-4df0-a29d-9d081bff6b4a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.889359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa30b-5b26-4df0-a29d-9d081bff6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.914212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c75aa30b-5b26-4df0-a29d-9d081bff6b4a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:04.916463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c75aa30b-5b26-4df0-a29d-9d081bff6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:04.936737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:04.952846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:04.957757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 153/297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:04.959064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a99b-7b83-4e96-a43c-24cecf19fe8d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.959729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a99b-7b83-4e96-a43c-24cecf19fe8d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.959997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a99b-7b83-4e96-a43c-24cecf19fe8d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.961420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 154/298] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:04.966843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:04.967137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:04.967359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:04.985705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:04.986877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:05.004184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 145/299] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:05.005484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebabcb-336e-4425-805e-a7ac83508bbe None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.005831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebabcb-336e-4425-805e-a7ac83508bbe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.006102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebabcb-336e-4425-805e-a7ac83508bbe None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.007561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 146/300] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:05.014191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.014473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.014747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.032577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:05.033792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:05.061204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 155/301] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:05.107562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 147/302] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:05.238686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.281457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.356420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae87c-a7db-495a-b0ce-b3c902b8fb1c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.378839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:05.384503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:05.393634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.394257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.394532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.394795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.397278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96babe81-dbd2-4c2d-a2bc-793f56866179 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.405023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:05.409966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:05.411027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:05.411839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 156/303] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:05.412478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.437240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.437864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.438139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.438406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.448104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:05.453773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:05.454696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:05.455845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 148/304] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:05.457609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.510794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120628b9-1de3-44dc-bfa6-18ea995b81d2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.543488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.544147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.544635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.544934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.554120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab4dbb-7aff-4936-ae46-816b558ff3ab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.554973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:05.560626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:05.561717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 157/305] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:05.562503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.590613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.591334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.591690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.591960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.593084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:05.594498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:05.596035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 149/306] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:05.596794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.610269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:05.616377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:05.666652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f244-b45e-4721-96ee-e0f836b9c7a4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.693885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4762-8cda-4f23-9f29-c0e8fd99b287 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.700397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.701193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.701468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.701738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.702401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:05.702705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:05.704082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:05.712175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 158/307] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:05.712980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.727072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.727674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.727948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.728216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.728902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:05.729200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:05.730554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:05.739071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 150/308] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:05.739848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.816795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:05.823803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e35d-b1df-45a7-a788-6b7340e6fb95 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.834841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:05.843295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bb2a-661f-4a43-85c1-e6805f95a621 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:05.859235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.859830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.860109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.860425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.861069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:05.861370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:05.862738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:05.870450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 159/309] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:05.873723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.875995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:05.876616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:05.876916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:05.877187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] PATH_INFO: `/v3/groups` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:05.877812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:05.879227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:05.908815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 151/310] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 28 12:09:05 2022] POST /identity/v3/groups => generated 229 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:05.908815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:05.983760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7accbf-900b-4ace-b7c8-9f4129c07d8d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.006278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc2bd-b7c1-4186-98ef-6ce06cc2a76e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.021146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.021804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.022082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.022354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] PATH_INFO: `/v3/users/15c6194c163f45748205a891327ff33e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.023621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] RBAC: Authorizing `identity:get_user(user_id=15c6194c163f45748205a891327ff33e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.025146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.032109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 160/311] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/users/15c6194c163f45748205a891327ff33e => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:06.032109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.049849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.050709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.050709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.050709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] PATH_INFO: `/v3/users/67df649438b04b01b20eb9df8eab21b5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.053450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.068849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] RBAC: Authorizing `identity:get_user(user_id=67df649438b04b01b20eb9df8eab21b5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.070292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.071964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 152/312] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:05 2022] GET /identity/v3/users/67df649438b04b01b20eb9df8eab21b5 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:06.077256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.085189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.148428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982ec6-0ac9-4b3d-835b-3e45164f32f0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.184392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.185578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.185853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.186111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] PATH_INFO: `/v3/users/c8f1276bff184387beba230c86917445` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.187218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] RBAC: Authorizing `identity:get_user(user_id=c8f1276bff184387beba230c86917445)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.188649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.189350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ece31-0bf5-4ebd-89f1-dfd975ae13d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.194767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 161/313] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:06 2022] GET /identity/v3/users/c8f1276bff184387beba230c86917445 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:06.194767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.230090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.230803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.231138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.231473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.295338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.300676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306075d-061b-4763-9f6a-7610ebbf9485 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.307259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.309006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.309495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.338022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.338616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.338886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.339152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.339865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] RBAC: Adding query filter params (role.id=c1eb0543035d40fea48a01f4984475a6, user.id=67df649438b04b01b20eb9df8eab21b5, scope.system=all) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:06.340166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.342067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.347062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 162/314] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 28 12:09:06 2022] GET /identity/v3/role_assignments?user.id=67df649438b04b01b20eb9df8eab21b5&scope.system=all&role.id=c1eb0543035d40fea48a01f4984475a6 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:06.347820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.457250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 153/315] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:06.460851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.500217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822e6c-8743-489f-af8d-152b6c455a12 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.547586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.548252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.548522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.548814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] PATH_INFO: `/v3/system/users/c8f1276bff184387beba230c86917445/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.550322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8f1276bff184387beba230c86917445, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.551733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.565279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 163/316] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 28 12:09:06 2022] PUT /identity/v3/system/users/c8f1276bff184387beba230c86917445/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:06.576681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.589041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f117ef-cde3-4ab8-bf88-054ba0630549 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.633796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee867b7-181d-466e-b7a2-6f1527ac33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.634453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee867b7-181d-466e-b7a2-6f1527ac33aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.634736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee867b7-181d-466e-b7a2-6f1527ac33aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.635011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee867b7-181d-466e-b7a2-6f1527ac33aa None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.636236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee867b7-181d-466e-b7a2-6f1527ac33aa None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.638315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee867b7-181d-466e-b7a2-6f1527ac33aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.640614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 154/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:06 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:06.647011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:06.687170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:06.760621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0592c6-8136-4ff3-9a74-41108c8312fa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:06.800577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:06.801223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:06.801501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:06.801770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:06.802502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] RBAC: Adding query filter params (role.id=c1eb0543035d40fea48a01f4984475a6, scope.project.id=39ed3440aded4079a334c8f86a922b76, user.id=15c6194c163f45748205a891327ff33e) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:06.802807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:06.804229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc456d-07d0-44af-8e1a-88d4d79a2d06 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:06.812911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 164/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:06 2022] GET /identity/v3/role_assignments?user.id=15c6194c163f45748205a891327ff33e&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=c1eb0543035d40fea48a01f4984475a6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:08.131994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2984d-00d6-4832-8a45-f269df2fd015 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.132514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2984d-00d6-4832-8a45-f269df2fd015 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.132514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2984d-00d6-4832-8a45-f269df2fd015 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.134253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 155/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:08.139647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4167-beda-4f02-ad38-b45375026469 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.140073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4167-beda-4f02-ad38-b45375026469 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.140213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4167-beda-4f02-ad38-b45375026469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.158571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f1cc4167-beda-4f02-ad38-b45375026469 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:08.159741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f1cc4167-beda-4f02-ad38-b45375026469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:08.229276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 165/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:08.502398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2984d-00d6-4832-8a45-f269df2fd015 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:08.587135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487422e3-c204-449e-b25c-9770ddbf44b9 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.587452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487422e3-c204-449e-b25c-9770ddbf44b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.587679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487422e3-c204-449e-b25c-9770ddbf44b9 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.589180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 166/321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:08.594461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ceb5b-0170-471b-9f79-7fa3a1b036ba None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.594741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ceb5b-0170-471b-9f79-7fa3a1b036ba None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.595012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ceb5b-0170-471b-9f79-7fa3a1b036ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.607695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2984d-00d6-4832-8a45-f269df2fd015 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:08.615386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-918ceb5b-0170-471b-9f79-7fa3a1b036ba None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:08.617048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-918ceb5b-0170-471b-9f79-7fa3a1b036ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:08.643029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:08.643654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.644309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.644309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.645358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:08.646789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:08.648334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:08.649142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 156/322] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:08.654539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:08.690095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:08.704848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 167/323] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:08.769115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38036b3f-e1c6-425c-9762-071d1cfd2c0d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:08.792209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de645731-c954-4c6a-a460-4e1db5340668 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.792523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de645731-c954-4c6a-a460-4e1db5340668 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.792816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de645731-c954-4c6a-a460-4e1db5340668 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.797507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 168/324] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:09:08.803267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.803267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.803471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.804617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:08.805352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:08.805629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:08.805892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] PATH_INFO: `/v3/groups` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:08.806683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:08.807909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:08.822520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:08.823687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:08.824615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 157/325] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 28 12:09:08 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:09:08.900718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 169/326] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:08.984814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.075731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.090047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a998c67-775a-4b4f-954b-4d1254687fc7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.129416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.130060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.130335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.130608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.142428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:09.147805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:09.148704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:09.149601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 158/327] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:09.155683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.182132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.267061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.281080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c1893-1ca9-4a7a-84bd-bc228fac40cb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.300476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf535f8-466d-430f-b153-f80617efc50c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.328397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.328964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.329251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.329502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.330173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:09.330468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:09.332108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:09.342987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 170/328] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:09.348339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.351113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.351991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.352473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.353205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.369209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:09.374603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:09.375478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:09.376294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 159/329] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:09.383554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.397656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.468307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76ddc-7a32-4e75-8a73-27794b75ee05 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.506934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.507584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.507856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.508119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] PATH_INFO: `/v3/users/67df649438b04b01b20eb9df8eab21b5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.509411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] RBAC: Authorizing `identity:get_user(user_id=67df649438b04b01b20eb9df8eab21b5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:09.510849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:09.514591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 171/330] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/users/67df649438b04b01b20eb9df8eab21b5 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:09.520713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.522428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17f44f-3b30-442e-afa9-d2572bb25523 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.547527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.569485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.571845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.572126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.573160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.574452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:09.574990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:09.577957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:09.590039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 160/331] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:09.595125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.644575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457de61a-796e-409c-8f0b-f93380596249 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.673812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.683287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.683937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.684209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.684479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] PATH_INFO: `/v3/system/users/67df649438b04b01b20eb9df8eab21b5/roles/c1eb0543035d40fea48a01f4984475a6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.686063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=67df649438b04b01b20eb9df8eab21b5, role_id=c1eb0543035d40fea48a01f4984475a6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:09.687678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:09.698770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 172/332] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 28 12:09:09 2022] PUT /identity/v3/system/users/67df649438b04b01b20eb9df8eab21b5/roles/c1eb0543035d40fea48a01f4984475a6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:09.719600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab3222-0a3d-41d1-a220-969dd3fbdd7d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.759864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6b566-1935-4ab6-b5b3-f8da32b4b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.760857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b566-1935-4ab6-b5b3-f8da32b4b4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.761275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b566-1935-4ab6-b5b3-f8da32b4b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.761677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b566-1935-4ab6-b5b3-f8da32b4b4a9 None admin] PATH_INFO: `/v3/users/c8f1276bff184387beba230c86917445` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.763551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6b566-1935-4ab6-b5b3-f8da32b4b4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=c8f1276bff184387beba230c86917445)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:09.765330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6b566-1935-4ab6-b5b3-f8da32b4b4a9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:09.767262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 161/333] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/users/c8f1276bff184387beba230c86917445 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:09.773419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:09.902933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:09.916548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93ec1b-f8f6-428e-aaa1-e091b08e9327 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:09.955563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:09.956441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:09.957071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:09.957339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:09.958140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] RBAC: Adding query filter params (role.id=a48e85fe9e11432b80cd16193d4069d6, user.id=c8f1276bff184387beba230c86917445, scope.system=all) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:09.958450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:09.959929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ef9f-48b3-47ff-96eb-5f9837c59d97 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:09.973104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 173/334] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 28 12:09:09 2022] GET /identity/v3/role_assignments?user.id=c8f1276bff184387beba230c86917445&scope.system=all&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:11.388180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107898f4-1e71-4457-bb0a-716c8a77f618 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:11.389419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107898f4-1e71-4457-bb0a-716c8a77f618 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:11.389914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107898f4-1e71-4457-bb0a-716c8a77f618 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:11.391697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 162/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:11.398528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:11.399335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:11.399795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:11.422357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:11.423847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:11.498874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 174/336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:11.811477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107898f4-1e71-4457-bb0a-716c8a77f618 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:11.947098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107898f4-1e71-4457-bb0a-716c8a77f618 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:11.988866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:11.989915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:11.990386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:11.990867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.003497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:12.007614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:12.012546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:12.013979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:12.014756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:12.016679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 163/337] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:12.022452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:12.108992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:12.145532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac14b11-f394-4c8d-b42f-5ff447bbf2fe None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:12.191564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:12.192167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.192437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.192702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.193392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:12.193687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:12.195055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5cc40-4e63-406d-be79-2591f1561eeb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:12.208962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 175/338] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:12.214349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:12.234485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f950f1-a5e7-477f-96ac-68c95c8c38bd None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.234809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f950f1-a5e7-477f-96ac-68c95c8c38bd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.235080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f950f1-a5e7-477f-96ac-68c95c8c38bd None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.237419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 176/339] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:12.244538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c073ef0-81b4-4c4d-921c-1bc451ccda48 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.244829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c073ef0-81b4-4c4d-921c-1bc451ccda48 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.245103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c073ef0-81b4-4c4d-921c-1bc451ccda48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.282020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9c073ef0-81b4-4c4d-921c-1bc451ccda48 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:12.283292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c073ef0-81b4-4c4d-921c-1bc451ccda48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:12.399595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9689-6e74-4796-b8d3-efa9422f1958 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:12.401109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 177/340] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:12.449820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:12.451004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.451282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.451557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.530718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:12.534193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:12.535833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:12.597533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c69a-febe-442a-8886-2602e78cbf84 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.597949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c69a-febe-442a-8886-2602e78cbf84 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.598221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c69a-febe-442a-8886-2602e78cbf84 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.599932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 178/341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:12.604920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.605194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.605462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.634924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:12.636105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:12.644818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 164/342] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:12.650472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:12.728192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:12.741877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 179/343] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:12.759517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:12.764173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b50dc-334d-4f97-b3ae-614477ed1c27 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:12.801530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:12.802164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.802438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.802706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.805697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:12.807189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:12.813203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 165/344] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:12 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:12.815529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:12.913766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:12.926258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa35d6-e4f7-477a-8446-109f9ef00623 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:12.977239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:12.977964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:12.978341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:12.978679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:12.990856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:12.992324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:12.998360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 180/345] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:12 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:13.013393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:13.072198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42bc4b-7580-4f89-9ab9-6dd95dd3b1c6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.115717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.132754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.133437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.133852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.134126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.147143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:13.152419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:13.155313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 166/346] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:13.157304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:13.188852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59003e-3994-4e16-9318-7b98598b06e6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.209184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.241659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.242278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.242558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.242827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.243568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=672965d8c3ca41d4986d57425b3d712c) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:13.243873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:13.245330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:13.253827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 181/347] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:13 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:13.256799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:13.291778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b663614-a372-4a0c-b735-a2530e5c517b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.374382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267158b2-a9e1-45d2-b396-3d6bd6a4460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.375027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267158b2-a9e1-45d2-b396-3d6bd6a4460e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.375347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267158b2-a9e1-45d2-b396-3d6bd6a4460e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.375567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267158b2-a9e1-45d2-b396-3d6bd6a4460e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.405518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267158b2-a9e1-45d2-b396-3d6bd6a4460e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-267158b2-a9e1-45d2-b396-3d6bd6a4460e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:13.410384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:13.411284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:13.412067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 167/348] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:13.412730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac74e9d-ea8e-4de0-a194-97093d7048aa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.413598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac74e9d-ea8e-4de0-a194-97093d7048aa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.413598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac74e9d-ea8e-4de0-a194-97093d7048aa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.414425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 168/349] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:13.427963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.428268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.428502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.471040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:13.472177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:13.482781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a07e9-3cf5-4e2d-8400-5960e1d54f2b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.517941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.534314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.538226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.538717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.539330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.540251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:13.540765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:13.542543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:13.553415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 182/350] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:13.554669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:13.567295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 169/351] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:13.568512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:13.598564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.681921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3858b-f880-4642-aea5-c5052ad859c1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.721213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.722152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.722627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.723111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.724072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:13.724617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:13.726300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:13.735916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 183/352] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:13.737845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7dfe0-7a5b-4b0e-8286-cc4359f68248 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.741743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:13.779788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9cc2f-636b-45d7-a0d1-d115caa8d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.780381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cc2f-636b-45d7-a0d1-d115caa8d27f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.780659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cc2f-636b-45d7-a0d1-d115caa8d27f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.781890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9cc2f-636b-45d7-a0d1-d115caa8d27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.801868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.864752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cc2f-636b-45d7-a0d1-d115caa8d27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:13.866224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9cc2f-636b-45d7-a0d1-d115caa8d27f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:13.867535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc418fc-b432-4231-9026-c2b3464d2db7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:13.886215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:13.909467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6a002-b98c-43ec-8c8f-3e8285c532b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:13.910131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6a002-b98c-43ec-8c8f-3e8285c532b0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:13.910364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6a002-b98c-43ec-8c8f-3e8285c532b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:13.910628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6a002-b98c-43ec-8c8f-3e8285c532b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:13.995964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6a002-b98c-43ec-8c8f-3e8285c532b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:13.998089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6a002-b98c-43ec-8c8f-3e8285c532b0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.003186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 170/353] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:14.004693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbeaa4-c8b7-491c-87c0-13310809b3e8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.005982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbeaa4-c8b7-491c-87c0-13310809b3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.006487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbeaa4-c8b7-491c-87c0-13310809b3e8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.014714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 171/354] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:14.015580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbeaa4-c8b7-491c-87c0-13310809b3e8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.081500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.165847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 184/355] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:14.169386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.169386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.169386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.194717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:14.195903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:14.220704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbeaa4-c8b7-491c-87c0-13310809b3e8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.240917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.264849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.265367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.265643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.265907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.267082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:14.268476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.270460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 172/356] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:14.271230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.281241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 185/357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:14.282487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.374604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.400340 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea96d7d-9e61-415c-a8a9-79b3db19a788 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.438877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.440037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.440513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.441047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.442445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:14.444158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.446167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 186/358] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:14.447128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.472861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f77e-a940-453b-863c-668bbaf7d25b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.539638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.540206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.540541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.540728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.563051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:14.564039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eda7e4-d6d3-435a-8774-696d2cc23301 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:14.568277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:14.569234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:14.570019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 173/359] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:14.570756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.605207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.606210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.606784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.607554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.609172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:14.610610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.612569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 187/360] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:14.613425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.630360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.645356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.713346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7d82c-2cbe-45ad-9a51-e1c722a2fabe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.723478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c1df9-07e1-457e-b7a6-ea6f88d0e73f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.754134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b67c14-b7a0-44de-b55b-3c71fd7586fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.755291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67c14-b7a0-44de-b55b-3c71fd7586fb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.755792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67c14-b7a0-44de-b55b-3c71fd7586fb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.756254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67c14-b7a0-44de-b55b-3c71fd7586fb None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.757668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b67c14-b7a0-44de-b55b-3c71fd7586fb None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:14.759451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b67c14-b7a0-44de-b55b-3c71fd7586fb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.760320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.761022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.761370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.761712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.762090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 174/361] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:14.763054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:14.763441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:14.764739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c6e91-93dd-426c-a842-1b12d4110d58 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.764944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49333318-5e40-48eb-956d-16034a308c80 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.765378 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c6e91-93dd-426c-a842-1b12d4110d58 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.765817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c6e91-93dd-426c-a842-1b12d4110d58 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.767425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 175/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:14.768311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c6e91-93dd-426c-a842-1b12d4110d58 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.776800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 188/363] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:14.778236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.779025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.779339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.804555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:14.809256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:14.892924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 189/364] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:14.894104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:14.898358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.914351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c6e91-93dd-426c-a842-1b12d4110d58 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:14.931873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:14.959863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:14.960901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:14.961461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:14.961944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:14.962957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=672965d8c3ca41d4986d57425b3d712c) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:14.963484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:14.965307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:14.974659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 176/365] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:14.975964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.035344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec3201-dcba-48c2-8dc7-32df362e53e1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.088408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.088408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.088712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.089034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.089950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=39ed3440aded4079a334c8f86a922b76) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:15.090262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:15.092630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:15.100003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 190/366] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:15.101239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.112825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dde02-804a-469e-af0a-618e03880799 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.159305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.160395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.162235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.162766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] PATH_INFO: `/v3/users/67df649438b04b01b20eb9df8eab21b5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.167510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] RBAC: Authorizing `identity:get_user(user_id=67df649438b04b01b20eb9df8eab21b5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:15.171285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:15.173519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 177/367] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:09:14 2022] GET /identity/v3/users/67df649438b04b01b20eb9df8eab21b5 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:15.180486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.226714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:15.273398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:15.310219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4766f-c922-4e44-97b0-685f2e761be2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.374854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.376533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.377123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.378250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.394184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e77f4-532d-4fd7-ba37-7fe9c049fe07 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.404525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:15.410251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:15.411142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:15.411982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:15.419528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 191/368] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:15.422189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.463186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.464362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.465802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.469046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.470029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] RBAC: Adding query filter params (role.id=c1eb0543035d40fea48a01f4984475a6, user.id=67df649438b04b01b20eb9df8eab21b5, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:15.470558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:15.472212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:15.493820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 178/369] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/role_assignments?user.id=67df649438b04b01b20eb9df8eab21b5&scope.system=all&role.id=c1eb0543035d40fea48a01f4984475a6 => generated 510 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:15.496216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.643070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c62a2f-08ad-4228-9330-da4bfbc54129 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.689248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d100a7-f7bc-4062-b45f-8bf43b26c82d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.691330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:15.703167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:15.720041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.720760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.721089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.721334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.732698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.733687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.734305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.734776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.735664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:15.736168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:15.737942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:15.744795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:15.748068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 179/370] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:15.750727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:15.751608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:15.752409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 192/371] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:15.754619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.757770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:15.872651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba24d5-d725-4326-acca-588e99decf16 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.918296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:15.919407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:15.919688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:15.919958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:15.958033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e24b8-2d28-44cb-9b72-dc17813cf8d6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:15.972264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:16.028037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:16.029237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.029685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.029954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.030632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:16.030862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.030966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.032288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.032396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.054182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 193/372] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:16.064331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:16.143031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:16.203551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405673f-057f-4018-928c-8efffab3ae2c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:16.216489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 180/373] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:16.223589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:16.251082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:16.251693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.252030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.252304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.337319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.339045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.354164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:16.405636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:16.408240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da155f0e-fb62-4250-b9c0-84c4a419aad3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:16.455172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90997cc6-4f31-4d02-bb00-5da378240bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:16.455630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90997cc6-4f31-4d02-bb00-5da378240bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.456221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90997cc6-4f31-4d02-bb00-5da378240bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.456522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90997cc6-4f31-4d02-bb00-5da378240bd9 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.457827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90997cc6-4f31-4d02-bb00-5da378240bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.459492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90997cc6-4f31-4d02-bb00-5da378240bd9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.461532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 181/374] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:16 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:16.462681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d7993-1d53-48fb-afbf-71bd89ca153a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.462953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d7993-1d53-48fb-afbf-71bd89ca153a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.463217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d7993-1d53-48fb-afbf-71bd89ca153a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.464642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 182/375] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:16.471000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.471267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.471539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.483048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 194/376] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:16.484184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:16.493689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:16.495310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:16.595736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 183/377] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:16.597047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:16.616024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab17c0-8f19-41fc-9460-f22e39548d21 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:16.656008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:16.656660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.656892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.657113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.658271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.659724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.661308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 195/378] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:16 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:16.667014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:16.670174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:16.688295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:16.729526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cd967-55e9-4d50-891e-00d9b01550af None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:16.797503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:16.798161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.798439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.798712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] PATH_INFO: `/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.799908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] RBAC: Authorizing `identity:get_project(project_id=d0ec0cb5de3946ab8e99e7fe425ccea6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.807844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.810589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 184/379] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:16 2022] GET /identity/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:16.815766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:16.863522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15aa7-d3f8-4a2d-9003-f52dd9339451 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:16.950035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc89d7a-6af9-4fe4-ab31-9a01e7069484 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:16.961481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:16.962090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:16.962362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:16.962623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:16.963348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=39ed3440aded4079a334c8f86a922b76) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:16.963646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:16.965099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:16.979822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 196/380] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:16 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 260 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:16.994470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:17.005791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.006489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.006770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.007040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] PATH_INFO: `/v3/groups/b85a67a290e746908c0d32395f8f9850` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.017429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] RBAC: Authorizing `identity:get_group(group_id=b85a67a290e746908c0d32395f8f9850)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:17.019241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:17.021592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 185/381] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:16 2022] GET /identity/v3/groups/b85a67a290e746908c0d32395f8f9850 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:17.029869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:17.066403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:17.189449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3e730-531e-4e89-864b-c3cbf0415d8b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:17.230641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:17.241155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.242071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.242356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.242627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.259965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:17.267317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:17.268308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:17.269182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:17.271855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 186/382] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:17.275921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:17.296096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335f29b-81f1-43f2-9038-45374e3d3490 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:17.344568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.345196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.345468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.345736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.346466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] RBAC: Adding query filter params (group.id=b85a67a290e746908c0d32395f8f9850, role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=d0ec0cb5de3946ab8e99e7fe425ccea6) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:17.346612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:17.349775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:17.351297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:17.359099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 197/383] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:17 2022] GET /identity/v3/role_assignments?group.id=b85a67a290e746908c0d32395f8f9850&scope.project.id=d0ec0cb5de3946ab8e99e7fe425ccea6&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:17.404969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a4e02-e7f2-425e-b970-81b093bc6efa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:17.445409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.446368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.446837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.447364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.448243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:17.448751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:17.450587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:17.464192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 187/384] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:17.468326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:17.584976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115626e-7cd3-43fd-8fc0-0df7401b371f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:17.621525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.622943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.623215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.623470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.624616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:17.626214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:17.632550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 198/385] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:17 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:17.633990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:17.745444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca6711-8a8d-4973-84f9-460ffe2be89e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:17.763351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:17.788505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead6472-6763-4c7d-918b-6a592b83e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.789204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6472-6763-4c7d-918b-6a592b83e651 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.789493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6472-6763-4c7d-918b-6a592b83e651 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.789767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead6472-6763-4c7d-918b-6a592b83e651 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.791027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead6472-6763-4c7d-918b-6a592b83e651 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:17.792516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead6472-6763-4c7d-918b-6a592b83e651 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:17.794840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 188/386] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:17 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:17.801440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:17.824301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:17.923968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b33b-0ba3-464f-a2e2-135f818b5b33 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:17.960763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad894003-c335-4700-887b-a416a55b08e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:17.961463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894003-c335-4700-887b-a416a55b08e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.961786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894003-c335-4700-887b-a416a55b08e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.962064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894003-c335-4700-887b-a416a55b08e7 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c/groups/e86d765af97f42d5b654d0233c414d25/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.963988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad894003-c335-4700-887b-a416a55b08e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=672965d8c3ca41d4986d57425b3d712c, group_id=e86d765af97f42d5b654d0233c414d25, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:17.965455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad894003-c335-4700-887b-a416a55b08e7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:17.978480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122778ea-7216-49e1-aeb0-5076be67158d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:17.978903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122778ea-7216-49e1-aeb0-5076be67158d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:17.979409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122778ea-7216-49e1-aeb0-5076be67158d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:17.981740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 189/387] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:09:17.984295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 199/388] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 28 12:09:17 2022] PUT /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c/groups/e86d765af97f42d5b654d0233c414d25/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:18.000714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47a5ce-b502-474f-b0e7-cf7fc0a56680 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:18.001036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47a5ce-b502-474f-b0e7-cf7fc0a56680 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:18.001292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47a5ce-b502-474f-b0e7-cf7fc0a56680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:18.034839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2f47a5ce-b502-474f-b0e7-cf7fc0a56680 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:18.036590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f47a5ce-b502-474f-b0e7-cf7fc0a56680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:18.121442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 190/389] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:18.343335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a16f0-28e3-43f0-8830-da22e566125e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:18.343725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a16f0-28e3-43f0-8830-da22e566125e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:18.343903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a16f0-28e3-43f0-8830-da22e566125e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:18.345278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 200/390] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:18.351308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:18.351856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:18.352373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:18.372646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:18.374214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:18.447387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 191/391] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:18.463191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a16f0-28e3-43f0-8830-da22e566125e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:18.575610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:18.609234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a16f0-28e3-43f0-8830-da22e566125e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:18.648946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:18.649562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:18.649840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:18.650108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:18.662852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:18.668237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:18.669791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:18.670584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:18.672501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 201/392] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:18.677876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:18.727771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:18.796023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29746c6a-a6cd-44bc-826d-8436bae88e93 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:18.839668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:18.840283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:18.840617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:18.840944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:18.841584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:18.841887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:18.843254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:18.857863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:18.858363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 192/393] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:18.859705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.010248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784dd53-7bbb-4958-b1a9-a32bd2cfda54 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.045443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec70ab-702f-4e8c-92d8-b2c894df6176 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.056472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:19.074751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.074751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.074751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.074751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.075992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:19.088616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:19.097607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:19.098536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:19.099339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:19.100538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.104839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 202/394] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:19.105963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.106825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.107105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.108146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.112148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:19.114505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:19.116307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 193/395] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:18 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:19.121463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.293211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643ae9d-408f-48f0-b185-b16b9038f96d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.314153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941f48-f556-4f78-9ac2-ff62266ea8c1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.364538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.366180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.366816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.368202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.370405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:19.370946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:19.373755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:19.387993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 203/396] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:19.393501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.394487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.394984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.395444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.396887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:19.398543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:19.400643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 194/397] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:19 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:19.402224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.406201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.493131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:19.510600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:19.583193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a7b1d-e0a5-4ac0-bcd1-23c17de90a0b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.586979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276adb2e-85c3-49e7-a70b-b002337d314c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.626799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.627853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.628341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.628873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76/groups/e86d765af97f42d5b654d0233c414d25/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.631515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] RBAC: Authorizing `identity:create_grant(project_id=39ed3440aded4079a334c8f86a922b76, group_id=e86d765af97f42d5b654d0233c414d25, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:19.633747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:19.655963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 195/398] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 28 12:09:19 2022] PUT /identity/v3/projects/39ed3440aded4079a334c8f86a922b76/groups/e86d765af97f42d5b654d0233c414d25/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:19.661620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.662267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.662544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.662815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.664016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:19.665503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:19.667355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 204/399] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:19 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:19.673604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.801394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f3d8d-c68e-459b-a1b4-eb1f5448b19c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.803917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:19.841533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db779-c053-4b01-b184-cdcbbd4f0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:19.842171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db779-c053-4b01-b184-cdcbbd4f0fbb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:19.842444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db779-c053-4b01-b184-cdcbbd4f0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:19.842710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db779-c053-4b01-b184-cdcbbd4f0fbb None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:19.843879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4db779-c053-4b01-b184-cdcbbd4f0fbb None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:19.845454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4db779-c053-4b01-b184-cdcbbd4f0fbb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:19.847444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 196/400] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:19 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:19.853299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:19.970244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6bbf-58fa-496b-bba0-a4f9c9077228 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:19.996644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:20.008978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f6f2-ded1-4404-81dd-2fffa6d91f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:20.009639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f6f2-ded1-4404-81dd-2fffa6d91f3d None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.009909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f6f2-ded1-4404-81dd-2fffa6d91f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.010230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f6f2-ded1-4404-81dd-2fffa6d91f3d None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c/groups/e86d765af97f42d5b654d0233c414d25/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.012961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f6f2-ded1-4404-81dd-2fffa6d91f3d None admin] RBAC: Authorizing `identity:create_grant(project_id=672965d8c3ca41d4986d57425b3d712c, group_id=e86d765af97f42d5b654d0233c414d25, role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:20.014421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f6f2-ded1-4404-81dd-2fffa6d91f3d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:20.037516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 205/401] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 28 12:09:19 2022] PUT /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c/groups/e86d765af97f42d5b654d0233c414d25/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:20.085305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542ff3-becb-46b3-aa1b-8000b291ec4b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.085643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542ff3-becb-46b3-aa1b-8000b291ec4b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.085835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad542ff3-becb-46b3-aa1b-8000b291ec4b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.087516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 197/402] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:20.093132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1371e-9fdc-45a1-8d48-b32a303d3b39 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.093710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1371e-9fdc-45a1-8d48-b32a303d3b39 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.094225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1371e-9fdc-45a1-8d48-b32a303d3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.114706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-35c1371e-9fdc-45a1-8d48-b32a303d3b39 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:20.116291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-35c1371e-9fdc-45a1-8d48-b32a303d3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:20.199443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 206/403] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:20.369966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4c70-2234-41e6-98df-f94203d4a098 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.370333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4c70-2234-41e6-98df-f94203d4a098 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.370532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4c70-2234-41e6-98df-f94203d4a098 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.372552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 198/404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:20.378367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.378650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.378918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.399170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:20.400331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:20.501801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4c70-2234-41e6-98df-f94203d4a098 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:20.503844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 207/405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:20.650329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4c70-2234-41e6-98df-f94203d4a098 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:20.691016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:20.691646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.691925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.692277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.708951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:20.714426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:20.715287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:20.716957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 199/406] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:20.724649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:20.800214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:20.879606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba41284-779e-410a-9453-6d558ee45548 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:20.924403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:20.927600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:20.928206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:20.928524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:20.928802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:20.929470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:20.929759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:20.931126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:20.946785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 208/407] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:20.955460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.007211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:21.078549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c388187-45ac-473a-8d49-f64736dfab63 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.093766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:21.117082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:21.117716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.117996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.118238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] PATH_INFO: `/v3/groups/b85a67a290e746908c0d32395f8f9850` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.119361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] RBAC: Authorizing `identity:get_group(group_id=b85a67a290e746908c0d32395f8f9850)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:21.120816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:21.123635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 209/408] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:20 2022] GET /identity/v3/groups/b85a67a290e746908c0d32395f8f9850 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:21.134654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.193084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af7ae3-a29a-4a24-b6cd-9aefc35afc83 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.228513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22c0e7-305f-4cd9-a470-314387ad79e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:21.229170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c0e7-305f-4cd9-a470-314387ad79e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.229449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c0e7-305f-4cd9-a470-314387ad79e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.229759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22c0e7-305f-4cd9-a470-314387ad79e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.243344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22c0e7-305f-4cd9-a470-314387ad79e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ac22c0e7-305f-4cd9-a470-314387ad79e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:21.251390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:21.253070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 200/409] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:21.255539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822c174-b739-487a-af8b-30d0415fa759 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.258210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822c174-b739-487a-af8b-30d0415fa759 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.258210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822c174-b739-487a-af8b-30d0415fa759 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.258210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 201/410] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:21.264803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822c174-b739-487a-af8b-30d0415fa759 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.266799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81203029-e926-4f29-8c98-f1afd1e485b9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.309957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf08e-319e-4f4d-b51d-49f212e51062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:21.310756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf08e-319e-4f4d-b51d-49f212e51062 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.311152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf08e-319e-4f4d-b51d-49f212e51062 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.311517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf08e-319e-4f4d-b51d-49f212e51062 None admin] PATH_INFO: `/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.312746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedf08e-319e-4f4d-b51d-49f212e51062 None admin] RBAC: Authorizing `identity:get_project(project_id=d0ec0cb5de3946ab8e99e7fe425ccea6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:21.314828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedf08e-319e-4f4d-b51d-49f212e51062 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:21.317181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 210/411] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:21 2022] GET /identity/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:21.318972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.319244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.319510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.345621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:21.346829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:21.376015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:21.384374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:21.389986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822c174-b739-487a-af8b-30d0415fa759 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.425677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:21.426050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 211/412] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:21.426255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.426580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.426844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.427500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:21.427845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:21.428177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.429339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:21.439660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 202/413] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:21.445346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.582452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3367d40-9532-450d-8a4b-5b032e21dfe4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.692345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a97ea2-7f05-4e9c-b0ca-4cfef73d7ec1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.709262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:21.710283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.710755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.711226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] PATH_INFO: `/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6/groups/b85a67a290e746908c0d32395f8f9850/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.714456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0ec0cb5de3946ab8e99e7fe425ccea6, group_id=b85a67a290e746908c0d32395f8f9850, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:21.717609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:21.745131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 212/414] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 28 12:09:21 2022] PUT /identity/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6/groups/b85a67a290e746908c0d32395f8f9850/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:21.750951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.775624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:21.776609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:21.777088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:21.777535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:21.780472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:21.782834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:21.785858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 203/415] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:21 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:21.790911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:21.827380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:21.837328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:21.979607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dacf5-d05a-48f9-b5e0-109c53f3b783 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:21.992104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35587a90-25b8-4026-915f-ec241eddd0a8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:22.037713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:22.038260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:22.038531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:22.038795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:22.040691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:22.042205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:22.044372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 204/416] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:21 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:22.050918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:22.053197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:22.053833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:22.054109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:22.054373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:22.067481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:22.072358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:22.074048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:22.076400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 213/417] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:22.080054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:22.229196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:22.253483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4a87-dbf0-4081-a8d0-1bb364119d63 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:22.268983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:22.283718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e88be-9365-4c5a-a1f6-6a72b7f7fc52 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:22.327123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:22.327797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:22.328074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:22.328342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76/groups/e86d765af97f42d5b654d0233c414d25/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:22.332138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=39ed3440aded4079a334c8f86a922b76, group_id=e86d765af97f42d5b654d0233c414d25, role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:22.333601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:22.354068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:22.354728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:22.355010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:22.355284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:22.356532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:22.356877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:22.358297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:22.360046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 205/418] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 28 12:09:22 2022] PUT /identity/v3/projects/39ed3440aded4079a334c8f86a922b76/groups/e86d765af97f42d5b654d0233c414d25/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:22.380555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 214/419] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:22.386452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:22.510948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a16cc-ed32-48bb-8e9c-e081642201e4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:22.554741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:22.555371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:22.555649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:22.555917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:22.597437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:22.642370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:22.643817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:22.752898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 206/420] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:22.755018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:22.865062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d773a4-60c2-4795-ae6e-63e46a54af3f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:22.901786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:22.902415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:22.902693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:22.903004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:22.904134 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:22.905611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:22.911980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 215/421] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:22 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:22.913415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:22.981774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:23.020723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6ae1b-4386-4a5a-ae29-45d595a1a865 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:23.056212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad919d-7537-4060-8261-541b8797d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:23.056901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad919d-7537-4060-8261-541b8797d97f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.057187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad919d-7537-4060-8261-541b8797d97f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.057457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad919d-7537-4060-8261-541b8797d97f None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.058559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad919d-7537-4060-8261-541b8797d97f None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:23.060622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad919d-7537-4060-8261-541b8797d97f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:23.068130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 207/422] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:22 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:23.069811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:23.074303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7e1f-b129-4664-9ad9-275c86e7753a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.074897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7e1f-b129-4664-9ad9-275c86e7753a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.075410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7e1f-b129-4664-9ad9-275c86e7753a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.077113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 208/423] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:23.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3ad0-1ed9-44ac-ae72-4686e0de255c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.085521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3ad0-1ed9-44ac-ae72-4686e0de255c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.085983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3ad0-1ed9-44ac-ae72-4686e0de255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.097698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:23.121865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f50a3ad0-1ed9-44ac-ae72-4686e0de255c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:23.123404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f50a3ad0-1ed9-44ac-ae72-4686e0de255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:23.233357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 209/424] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:23.236223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf50b8-ade9-414a-82ed-aa95e7b3c43b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:23.271233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:23.271825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.272099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.272368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.273156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=672965d8c3ca41d4986d57425b3d712c) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:23.273519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:23.275001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1af35-1650-4543-a12e-1724f167486a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:23.286306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 216/425] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:23 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:23.369331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f04a47-3325-41cc-b6fe-1c075fc9659e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.369628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f04a47-3325-41cc-b6fe-1c075fc9659e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.369786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f04a47-3325-41cc-b6fe-1c075fc9659e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.371159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 210/426] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:23.377612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205743e-a359-484f-9b76-955e43c60368 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.377959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205743e-a359-484f-9b76-955e43c60368 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.378227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205743e-a359-484f-9b76-955e43c60368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.405932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0205743e-a359-484f-9b76-955e43c60368 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:23.407155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0205743e-a359-484f-9b76-955e43c60368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:23.503389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 217/427] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:23.553651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f04a47-3325-41cc-b6fe-1c075fc9659e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:23.604631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:23.664853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f04a47-3325-41cc-b6fe-1c075fc9659e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:23.707373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:23.708012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.708331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.708596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.723822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:23.728929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:23.729890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:23.731701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 211/428] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:23.737647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205743e-a359-484f-9b76-955e43c60368 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:23.760454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:23.831280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:23.877432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205743e-a359-484f-9b76-955e43c60368 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:23.917843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:23.918365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:23.918669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:23.919083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:23.919997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] RBAC: Adding query filter params (name=member) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:23.920298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:23.921730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:23.930660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 218/429] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:23.936237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:23.967053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca3fbd-a77c-4a82-99b0-e5a8a4354a27 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:23.977467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.007935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.009517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.011323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.011823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.024308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:24.029648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:24.030581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:24.031354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:24.034849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.036249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 212/430] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:24.043271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.062943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c345-3ceb-4031-806b-6fcddcdb1b60 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.105230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.105875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.106263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.106714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.164678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca4e2-c115-42ba-80a5-99c1af712733 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.196140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.198804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.217743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.218450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.218760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.219049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.219761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:24.220065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.221799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.238845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 213/431] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:24.240811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.274074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.308793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.342705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 219/432] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:24.347980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.366106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac96c63-d285-4339-a95d-873f162b96b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.402531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e325a0-2655-4003-ade2-cc6c60a541d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.403746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e325a0-2655-4003-ade2-cc6c60a541d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.404026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e325a0-2655-4003-ade2-cc6c60a541d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.404290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e325a0-2655-4003-ade2-cc6c60a541d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.447072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968e3c-3a0c-4a45-80a6-584c9691e256 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.475906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e325a0-2655-4003-ade2-cc6c60a541d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.477378 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e325a0-2655-4003-ade2-cc6c60a541d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.490948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0dbc8-4e79-4974-8fe2-4d7a31753f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.491581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0dbc8-4e79-4974-8fe2-4d7a31753f76 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.491856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0dbc8-4e79-4974-8fe2-4d7a31753f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.492374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0dbc8-4e79-4974-8fe2-4d7a31753f76 None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.493975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0dbc8-4e79-4974-8fe2-4d7a31753f76 None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.495937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0dbc8-4e79-4974-8fe2-4d7a31753f76 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.502726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 220/433] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:24.502726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58143944-5ca2-4b96-8c8e-ed0aaaf76f25 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.502726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58143944-5ca2-4b96-8c8e-ed0aaaf76f25 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.502726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58143944-5ca2-4b96-8c8e-ed0aaaf76f25 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.502726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 221/434] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:24.504117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58143944-5ca2-4b96-8c8e-ed0aaaf76f25 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.509685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.558136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.594921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 214/435] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:09:24.594921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.594921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.594921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.613115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:24.614292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:24.615266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58143944-5ca2-4b96-8c8e-ed0aaaf76f25 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.651791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.652413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.652682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.653008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.654131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.655550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.661721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 222/436] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:24.661721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.691547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 215/437] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:24.692252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.759943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.777078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448334df-a7c5-42d7-9a6c-2bb4a6dfa474 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.792382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:24.804996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc3e19-72bd-4cd1-824a-4b0669462a23 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.820858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.820858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.820858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.820858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] PATH_INFO: `/v3/projects/672965d8c3ca41d4986d57425b3d712c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.821218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] RBAC: Authorizing `identity:get_project(project_id=672965d8c3ca41d4986d57425b3d712c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.821218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.825262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 223/438] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/projects/672965d8c3ca41d4986d57425b3d712c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:24.826517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.842603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.843352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.843717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.844077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.844922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=a48e85fe9e11432b80cd16193d4069d6, scope.project.id=39ed3440aded4079a334c8f86a922b76) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:24.845321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.846843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.861110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 216/439] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=a48e85fe9e11432b80cd16193d4069d6 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:24.940960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4885b-8f9a-4c6a-b53e-81aefbf23949 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:24.961764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:24.982292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:24.982937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:24.983215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:24.983478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:24.984725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:24.986349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:24.992914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 224/440] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:24.994885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.051580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.081379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8a6dc-aa4b-4859-8b14-ae455eaa881b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.109843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.114101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dc60c-cbcf-41e6-a670-e45129f2144e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.125157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b425-49f8-44be-b7c4-ef2a45396b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.126145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b425-49f8-44be-b7c4-ef2a45396b28 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.126430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b425-49f8-44be-b7c4-ef2a45396b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.126706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b425-49f8-44be-b7c4-ef2a45396b28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.137596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78b425-49f8-44be-b7c4-ef2a45396b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8b78b425-49f8-44be-b7c4-ef2a45396b28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:25.142965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:25.144034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:25.145101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 217/441] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:25.145910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7b7f-c45c-4bd5-84b8-638f76249afa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.145910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7b7f-c45c-4bd5-84b8-638f76249afa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.145910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7b7f-c45c-4bd5-84b8-638f76249afa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.147198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 218/442] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:25.149811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7b7f-c45c-4bd5-84b8-638f76249afa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.154900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.155501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.155774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.156041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.156770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=672965d8c3ca41d4986d57425b3d712c) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:25.157097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:25.158522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765eef-02c9-4c2d-98e0-debbb2552f31 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:25.164378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 225/443] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:24 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=672965d8c3ca41d4986d57425b3d712c&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:25.165544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.165820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.166083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.187493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:25.188729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:25.265367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7b7f-c45c-4bd5-84b8-638f76249afa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.270839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 226/444] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:25.310719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.311346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.311625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.311891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.312579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:25.312897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:25.314269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:25.329489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 219/445] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:25.331077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.380103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.437713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82aff4-4bfe-495e-8085-f97011b3e5b9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.476425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.477048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.477318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.477581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.542513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.546907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:25.548415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:25.596338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.603209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.664810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 227/446] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:25.671877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.672556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad6fe-584c-4b3e-abb0-74999ffba3c9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.709439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.710069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.710446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.710610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.724360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:25.729273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:25.730331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:25.731353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:25.736309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 220/447] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:25.736309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.783485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b2cad-338e-47c4-b51c-39ddc84563e3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.819510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.820123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.820391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.820653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] PATH_INFO: `/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.821776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d0ec0cb5de3946ab8e99e7fe425ccea6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:25.823199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:25.825405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 228/448] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/projects/d0ec0cb5de3946ab8e99e7fe425ccea6 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:25.830661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.837115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e1561-8be6-403b-bf46-b6701e491034 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.839798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.845187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:25.872349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.872884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.873158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.873777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.874427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:25.875024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:25.876391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:25.884024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 221/449] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:25.890044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.929603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e5080-2e07-4c4d-b1b3-39ecca6fc6d7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:25.963032 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:25.963647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:25.963923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:25.964192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] PATH_INFO: `/v3/groups/b85a67a290e746908c0d32395f8f9850` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:25.965953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] RBAC: Authorizing `identity:get_group(group_id=b85a67a290e746908c0d32395f8f9850)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:25.967411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:25.969087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 229/450] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/groups/b85a67a290e746908c0d32395f8f9850 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:25.974755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:25.986472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dbc9b-8c13-457e-91f2-3edef45d4e8c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:26.019666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:26.020266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:26.020536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:26.020823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:26.052768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:26.052991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:26.072277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092c1ef-3fe6-40a0-89db-2ea337e62f6c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:26.087493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:26.088959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:26.107306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:26.107900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:26.108175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:26.108444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:26.109193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] RBAC: Adding query filter params (group.id=b85a67a290e746908c0d32395f8f9850, role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=d0ec0cb5de3946ab8e99e7fe425ccea6) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:26.109497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:26.110917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:26.117030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 230/451] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/role_assignments?group.id=b85a67a290e746908c0d32395f8f9850&scope.project.id=d0ec0cb5de3946ab8e99e7fe425ccea6&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:26.192311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 222/452] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 12:09:26.198033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:26.303889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b5c8-e030-48c9-bbb0-228654ea3dc0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:26.338173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:26.338782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:26.339154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:26.339423 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] PATH_INFO: `/v3/projects/39ed3440aded4079a334c8f86a922b76` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:26.341115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] RBAC: Authorizing `identity:get_project(project_id=39ed3440aded4079a334c8f86a922b76)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:26.342549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:26.344175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 231/453] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:09:26 2022] GET /identity/v3/projects/39ed3440aded4079a334c8f86a922b76 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:26.349987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:26.412571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:26.445949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0324e1f-4dd4-4288-a0f2-514754bb7906 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:26.478475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436346f-ad8a-4002-a4c3-e2083ac8a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:26.479083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436346f-ad8a-4002-a4c3-e2083ac8a131 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:26.479360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436346f-ad8a-4002-a4c3-e2083ac8a131 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:26.479627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436346f-ad8a-4002-a4c3-e2083ac8a131 None admin] PATH_INFO: `/v3/groups/e86d765af97f42d5b654d0233c414d25` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:26.480706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436346f-ad8a-4002-a4c3-e2083ac8a131 None admin] RBAC: Authorizing `identity:get_group(group_id=e86d765af97f42d5b654d0233c414d25)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:26.482359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436346f-ad8a-4002-a4c3-e2083ac8a131 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:26.483896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 223/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 28 12:09:26 2022] GET /identity/v3/groups/e86d765af97f42d5b654d0233c414d25 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:26.489703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:26.504754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:26.585858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b39f-5bf3-476d-aefb-383878523e1a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:26.617570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:26.618146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:26.618415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:26.618676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:26.619390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] RBAC: Adding query filter params (group.id=e86d765af97f42d5b654d0233c414d25, role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=39ed3440aded4079a334c8f86a922b76) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:26.619692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:26.621130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8bdb-09d2-41d9-8a3e-5dabfdcdb1b7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:26.627598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 232/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 28 12:09:26 2022] GET /identity/v3/role_assignments?group.id=e86d765af97f42d5b654d0233c414d25&scope.project.id=39ed3440aded4079a334c8f86a922b76&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:29.244094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b5073-b76e-49ae-82e7-6027d5cdae19 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:29.244629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b5073-b76e-49ae-82e7-6027d5cdae19 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:29.244629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b5073-b76e-49ae-82e7-6027d5cdae19 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:29.245975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 224/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:29.251923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9fb7-5245-4619-9c8b-e899348b7070 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:29.252383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9fb7-5245-4619-9c8b-e899348b7070 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:29.252455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9fb7-5245-4619-9c8b-e899348b7070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:29.277846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d3dc9fb7-5245-4619-9c8b-e899348b7070 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:29.279049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d3dc9fb7-5245-4619-9c8b-e899348b7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:29.362465 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 233/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:29.648963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419ba0-b962-47f1-9871-3501d64f1248 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:29.649658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419ba0-b962-47f1-9871-3501d64f1248 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:29.650162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419ba0-b962-47f1-9871-3501d64f1248 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:29.651849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 225/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:29.658434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e462ee-4a2e-4fdf-b60c-4ef80a872914 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:29.658741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e462ee-4a2e-4fdf-b60c-4ef80a872914 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:29.658985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e462ee-4a2e-4fdf-b60c-4ef80a872914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:29.675172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:29.689784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-26e462ee-4a2e-4fdf-b60c-4ef80a872914 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:29.690974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-26e462ee-4a2e-4fdf-b60c-4ef80a872914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:29.773890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 234/459] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:29.804040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e1417-2e3b-432f-93b8-53a5ab781cc4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:29.804334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e1417-2e3b-432f-93b8-53a5ab781cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:29.804583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e1417-2e3b-432f-93b8-53a5ab781cc4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:29.806223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 226/460] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:29.812419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:29.812702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:29.813002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:29.828390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e1417-2e3b-432f-93b8-53a5ab781cc4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:29.835844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:29.837037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:29.914322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 235/461] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:29.998882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e1417-2e3b-432f-93b8-53a5ab781cc4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.049001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.049630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.050034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.050244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.053977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:30.064065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.065605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:30.085193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:30.086071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:30.086893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:30.086893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:30.086893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:30.086893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 227/462] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:30.092899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.161957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:30.208258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d14da-a177-4797-bd91-92dbd839b044 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.213214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.244992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.245654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.245932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.246199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.247476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:30.247883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.249294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 236/463] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:30.270238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.333428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1dca8-5490-49fb-94a8-328900ae0f0e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.372508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.373514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.373954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.374408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.385785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.387614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.399292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd256-a441-422b-9ac4-1fbb4892d519 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:30.401988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:30.403686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:30.404613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:30.404613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:30.404613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:30.406030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 228/464] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:30.406905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.434171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:30.444608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.444964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.445247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.445577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.449811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:30.459436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.461211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:30.479211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:30.480344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:30.481394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:30.481394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:30.481394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:30.481394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 237/465] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:30.481394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.520367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d7fb6-3abb-4a41-a541-977945271e83 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.556768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657219b-5222-4ed8-89f0-2fd4a19afb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.557538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657219b-5222-4ed8-89f0-2fd4a19afb86 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.557817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657219b-5222-4ed8-89f0-2fd4a19afb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.558142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657219b-5222-4ed8-89f0-2fd4a19afb86 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.558781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657219b-5222-4ed8-89f0-2fd4a19afb86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.560572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657219b-5222-4ed8-89f0-2fd4a19afb86 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.592807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 229/466] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:30 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:30.592807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222a708-a84c-4547-810a-6ea1fad282c4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.593095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0a8f4-b615-4f08-bb08-4dec5c2e374a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.593174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222a708-a84c-4547-810a-6ea1fad282c4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.593174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222a708-a84c-4547-810a-6ea1fad282c4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.594209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 230/467] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:30.596198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222a708-a84c-4547-810a-6ea1fad282c4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.630536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.631295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.631638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.632033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.632980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:30.633350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.634952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a95b8e-c19b-47c8-9792-ed5de9433f50 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.654755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 238/468] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:30.656426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.656830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.657258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.679040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:30.680444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:30.720462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:30.728914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:30.740030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222a708-a84c-4547-810a-6ea1fad282c4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.785339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 239/469] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:30.786725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.792003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.792621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.792923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.793707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.794389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:30.794687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.796138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.812228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 231/470] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:30.817886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:30.923809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b188a3e-0529-4f89-b94d-cdfb5a3140aa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.958212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270d99-392c-4f96-b459-6230c722dd21 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:30.964329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677da36-1779-4d99-80f0-97566ed0ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:30.964995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677da36-1779-4d99-80f0-97566ed0ec41 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:30.965980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677da36-1779-4d99-80f0-97566ed0ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:30.966266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677da36-1779-4d99-80f0-97566ed0ec41 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:30.966910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677da36-1779-4d99-80f0-97566ed0ec41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:30.968555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677da36-1779-4d99-80f0-97566ed0ec41 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:30.997549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 240/471] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:30 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:30.999661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35961960-fbf6-42b0-9eab-af12ffca1a83 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.000474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35961960-fbf6-42b0-9eab-af12ffca1a83 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.000975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35961960-fbf6-42b0-9eab-af12ffca1a83 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.002897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 241/472] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:31.004417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:31.012421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.012421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.012421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.012421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:31.012421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:31.013097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.013097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.013097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.035885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:31.037074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 232/473] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:30 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:31.037643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:31.060095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:31.098538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:31.115857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:31.143369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 242/474] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:31.270720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3c49-d6c8-4352-9ddc-72a26a5381f0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:31.306657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:31.307281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.307557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.307819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.318461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:31.319898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:31.335543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:31.337201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:31.338022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:31.338022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:31.338022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:31.338022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 233/475] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:31.344028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:31.447318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:31.467486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252241de-d9cf-4377-b041-b2b434647ed2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:31.515457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:31.516654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.517148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.517843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.519179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:31.519962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:31.522239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:31.536518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:31.539323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 243/476] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:31.548939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:31.566732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:31.627494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1aa10-69f2-46d8-8a77-8f5e9a4bc7da None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:31.700153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:31.700760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.701059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.701327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.701996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:31.703353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:31.711097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad68cb-0948-43ea-ab9e-4fbdeda8b0ac None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:31.728104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 12:09:31.728104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 28 12:09:31.728104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [parameters: {'id': '9e92652bd5a149259a4d8df2ba969fa2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 28 12:09:31.728104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 28 12:09:31.747693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return ref.to_dict() Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:09:31.748589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 12:09:31.749545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 12:09:31.750379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:09:31.751214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:09:31.752014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'id': '9e92652bd5a149259a4d8df2ba969fa2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:31.753910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 28 12:09:31.756063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:31.758216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 234/477] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 28 12:09:31 2022] POST /identity/v3/roles => generated 144 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:31.758216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:31.787718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:31.788615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.788915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.789184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.789833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:31.791269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:31.835118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 244/478] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:31 2022] POST /identity/v3/users => generated 249 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:31.926721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c117eca-4287-4a71-a44e-4a689b9dac57 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:31.964588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:31.977582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c9592-36b4-4435-a17a-2557bd2e2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:31.978233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c9592-36b4-4435-a17a-2557bd2e2446 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:31.978508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c9592-36b4-4435-a17a-2557bd2e2446 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:31.978776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c9592-36b4-4435-a17a-2557bd2e2446 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:31.998850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c9592-36b4-4435-a17a-2557bd2e2446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8f6c9592-36b4-4435-a17a-2557bd2e2446 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:32.004386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:32.005403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:32.006180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 235/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:09:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:32.012482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:32.088168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:32.123723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45c37-04f1-4a12-a938-9411a5dd8bbb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:32.161680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:32.162518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:32.162744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:32.163011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:32.163684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:32.163984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:32.165437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c04d-4bc0-4776-a356-e4a4ef8112e8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:32.174789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 245/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:33.372135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6463-4368-4bfa-bf15-308f78f503d9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:33.372878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6463-4368-4bfa-bf15-308f78f503d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:33.373054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6463-4368-4bfa-bf15-308f78f503d9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:33.374628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 236/481] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:33.380172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa73898-e3ea-4964-a84a-17d76dcfeb02 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:33.380676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa73898-e3ea-4964-a84a-17d76dcfeb02 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:33.380873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa73898-e3ea-4964-a84a-17d76dcfeb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:33.399983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-eaa73898-e3ea-4964-a84a-17d76dcfeb02 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:33.401175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eaa73898-e3ea-4964-a84a-17d76dcfeb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:33.472872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 246/482] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:33.747025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6463-4368-4bfa-bf15-308f78f503d9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:33.806239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21c2e-d72d-4d57-9b6f-df679c131a0b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:33.806578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21c2e-d72d-4d57-9b6f-df679c131a0b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:33.806784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db21c2e-d72d-4d57-9b6f-df679c131a0b None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:33.809201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 247/483] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:33.815412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ff03-5460-4083-9fa9-5c55399fc0d9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:33.815683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ff03-5460-4083-9fa9-5c55399fc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:33.815949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ff03-5460-4083-9fa9-5c55399fc0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:33.843287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b536ff03-5460-4083-9fa9-5c55399fc0d9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:33.844487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b536ff03-5460-4083-9fa9-5c55399fc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:33.929875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6463-4368-4bfa-bf15-308f78f503d9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:33.956461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:33.975149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 248/484] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:33.976447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d64c-61a0-4c18-863c-269598e69c83 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:33.976764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d64c-61a0-4c18-863c-269598e69c83 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:33.977057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d64c-61a0-4c18-863c-269598e69c83 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:33.978484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 249/485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:33.985829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:33.986101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:33.986371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.004221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.004801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.005065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.005327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.019216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:34.020389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:34.029783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:34.034585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:34.035450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:34.036656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 237/486] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:34.042592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.095921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 250/487] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:34.119474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:34.174591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766de0-d1e8-4eb5-99e2-15bacabce1ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.209632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.210239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.210518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.210784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.211443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:34.211743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:34.213134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:34.221913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 238/488] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:34.227521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.335728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6de53-6ee4-4e64-a9c6-d9ea091f6702 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.365776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:34.369921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.371961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.372927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.373555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.374069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.384917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:34.387935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:34.404128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:34.405114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:34.406069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:34.406069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:34.406069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:34.406069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 251/489] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:34.414895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.526152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1811e77-8771-4429-a666-fc4a67f6c4a9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.541676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c1d6a-5ab8-46b4-9c61-6f09309c1f38 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.556105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:34.562818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.563140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.563407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.563673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.564371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:34.564674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:34.566066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:34.584091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 252/490] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:34.584891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.595575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.596512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.597477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.597997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.613470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:34.622728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:34.623656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:34.624434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:34.625954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:34.626062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 239/491] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:34.632943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.708808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c686-908c-419c-b7ac-72b692bf293a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.746978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.747917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.748333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.748601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.759541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:34.765627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:34.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 253/492] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:34.767941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.779981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32182af8-c56b-45b7-bdcc-7554e40b36b8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.820063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.820685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.820994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.821268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.829370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:34.831051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:34.843819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:34.844721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 240/493] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:34.845712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.875658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:34.877209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:34.884537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88442b3b-f778-4e24-a585-ed9726d18ed0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:34.922231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:34.923052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.923251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.923522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.924254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:34.924479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:34.926128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d18b43-75a7-4538-9752-fbc268f0ba97 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:34.939428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 254/494] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:34.939428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e2a53-bb3d-4c45-9d9c-8fc363509ea3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:34.939428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e2a53-bb3d-4c45-9d9c-8fc363509ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:34.939428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e2a53-bb3d-4c45-9d9c-8fc363509ea3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:34.939428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 255/495] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:34.939428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e2a53-bb3d-4c45-9d9c-8fc363509ea3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:34.966592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22fff8-3733-4a31-b13e-ae050108e890 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.004008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.004605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.004942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.005214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.005922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:35.006163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.007544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.020872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 241/496] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:35.020872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.054320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e2a53-bb3d-4c45-9d9c-8fc363509ea3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.089363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.090043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.090328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.090589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.091342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:35.091641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.093108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124eca2-20d9-4c00-b942-bb5c7cc47058 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.118005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.128200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c670af-68f5-4975-8c2f-484c2a747412 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.141207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 256/497] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:09:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:35.141207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bed4-daf6-4bc1-923a-ee6c22678dd8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.141207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bed4-daf6-4bc1-923a-ee6c22678dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.141207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bed4-daf6-4bc1-923a-ee6c22678dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.157693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4333bed4-daf6-4bc1-923a-ee6c22678dd8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:35.158877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4333bed4-daf6-4bc1-923a-ee6c22678dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:35.161092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.161717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.161989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.162255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.168924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.174130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.175554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:35.189959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:35.190967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:35.191794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:35.191794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:35.191794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:35.191794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 242/498] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:35.191794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.228714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 257/499] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:35.229954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522175ac-d32c-43ab-be91-4bd35e97c391 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.230230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522175ac-d32c-43ab-be91-4bd35e97c391 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.230494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522175ac-d32c-43ab-be91-4bd35e97c391 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.232559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 258/500] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:35.233282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522175ac-d32c-43ab-be91-4bd35e97c391 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.298802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119ef7-062f-44b4-80ea-c263bf4f2c5e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.332157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335766b9-2078-413b-9604-953825148f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.332786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335766b9-2078-413b-9604-953825148f8e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.333077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335766b9-2078-413b-9604-953825148f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.333345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335766b9-2078-413b-9604-953825148f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.336897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522175ac-d32c-43ab-be91-4bd35e97c391 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.344978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335766b9-2078-413b-9604-953825148f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.346652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335766b9-2078-413b-9604-953825148f8e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.348429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-335766b9-2078-413b-9604-953825148f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:35.363826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:35.364740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:35.365660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:35.365660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:35.365660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:35.365660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 243/501] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:35.365872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335766b9-2078-413b-9604-953825148f8e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.378173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.378707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.378984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.379364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.393762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.448516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.450050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.472630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335766b9-2078-413b-9604-953825148f8e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.509315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.510222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.510494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.510759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.511387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:35.511682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.513432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21087-6258-42e8-a2c0-7a748e5d6f71 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.524729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 244/502] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:35.525886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.526162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.526433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.545367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:35.546533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:35.555237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 259/503] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:35.556071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.595345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.600934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.613146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 245/504] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:35.613951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.659086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef2d3-2f44-4bc6-ac6f-0807e21bc5ff None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.693643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.694232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.694508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.694777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.695418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:35.695723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.697123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.708500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 260/505] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:35.709327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.723275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353438ac-3844-4f9c-86af-2bb2be6a2922 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.758296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.758922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.759197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.759464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.769855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:35.774583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:35.775448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:35.776268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 246/506] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:35.777627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.828535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f596-f9ea-42a3-849d-41a3409b32c6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.831509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.835444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:35.864491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.865150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.865424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.865687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.872887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.874329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:35.889077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:35.890135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:35.891074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 261/507] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:35.891632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.895861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8a7db-0f5c-4d86-bc7e-f413be4b774b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:35.930077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:35.930615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:35.930885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:35.931147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:35.941864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:35.943297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:35.957994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:35.958957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:35.959796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:35.959796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:35.959796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:35.959796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 247/508] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:35.960030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:35.990560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6920f-2d92-4b49-8425-2be7bfb76d41 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.023952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.024569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.024882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.025159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.033022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.034479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:36.045347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:36.046278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 262/509] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:36.047161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.057510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.064008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861012-84c6-4894-bea0-e690301b8c6d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.071598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.097583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.098260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.098534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.098799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.099460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:36.099778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.101153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.108819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 248/510] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:36.109609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.145095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836be87-7790-4f3c-8acb-58e8da3a24b4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.182082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.182631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.182912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.183182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.193603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.195062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:36.209530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:36.210609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:36.211678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:36.211678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:36.211678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:36.211874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84523f8a-b4df-4d1f-8e7c-6fb2a4600de3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.211948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 263/511] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:36.211948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.246564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.247301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.247579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.247854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.248556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:36.248883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.250272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.286418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 249/512] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:36.287244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.294223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.304799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.318322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb38cb-4546-480d-93d6-bce337d582d6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.351906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.352731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.353047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.353320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.353955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:36.354254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.355712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.367758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 264/513] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:36.373668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.385465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3747-538d-40aa-acf5-32f51532a298 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.419957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.420550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.420852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.421118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.421832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:36.422126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.423534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.440492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 250/514] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:36.441261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.475865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee4b77-ef78-4711-ba67-4121792a2284 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.509706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.510320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.510604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.510864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.514400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.516643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.522758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.524253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:36.540397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:36.541343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:36.542207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:36.542207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:36.542207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:36.542207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 265/515] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:36.542438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692056e5-b784-4764-98f4-26f2bd74c36b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.542792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.575688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.576308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.576554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.576848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.577484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:36.577779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.579137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.590723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 251/516] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:36.591642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.653840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f10bd6-da19-4941-8ae1-5fdbbd389ac4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.687096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.687783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.687987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2bc2f-a0f3-45bc-9348-c28202fd43ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.688218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.688551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.721409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.721954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.722230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.722493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.724330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.729848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.731901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:36.743316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:36.744256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:36.750647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:36.751148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.751232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 252/517] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:36.751232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.764412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.765892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.846412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828c3a3-546e-4ba2-a021-64a463007cf5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.866008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 266/518] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:36.866841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:36.883281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.883912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.884190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.884459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.943005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.951460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:36.952590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:36.952941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:36.965277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9394f-6ec9-4489-b98b-b67095658c51 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:36.998121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:36.998639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:36.998910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:36.999182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:36.999824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:37.000118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.001511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.012883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 267/519] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:37.013579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.054134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 253/520] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:37.055182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.111884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945889a8-09f3-4837-8404-9cbdff2ec238 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.145359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.145956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.146229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.146498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.147132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.148575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.149473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.156426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbacc4f-697a-4d05-a8a6-b882295bdac3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.170580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 268/521] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:37 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:37.171391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.174798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.208368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.209111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.209459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.209938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.210586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:37.210895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.212360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.239076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 254/522] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:37.239076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.295722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccab09-380a-48b2-a9bc-0cc377c884c9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.333680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.334318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.334589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.334853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.346434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.347891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.349887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eb402-84ef-4eb8-980d-e97c010a24dc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:37.364442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:37.365410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:37.367045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:37.367045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:37.367045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:37.367045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 269/523] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:37.367045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.397897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.398560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.398836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.399224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.406954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.408380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:37.422330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:37.423286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:37.424154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 255/524] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:37.424703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.436436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.442450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.485024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499a9a6-2933-444e-8367-d51ce5e82010 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.521389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.522009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.522284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.522558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.533242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.534688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.539256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1825430-1fa1-416d-b6bb-60d0c3f27546 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:37.551921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:37.553045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:37.553896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:37.553896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:37.553896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:37.554348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 270/525] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:37.554998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.578895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.579933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.580223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.580506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.581525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=a5e487f1b5af4aa0a2d922d374adc29f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:37.581834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.583344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.588975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 256/526] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/role_assignments?user.id=a5e487f1b5af4aa0a2d922d374adc29f&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:37.590337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.679675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9a12-59cb-431a-b090-7ba52882a178 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.691129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.708452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.727790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.729162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.729904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.730348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.731736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:37.732675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.734580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.735091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663b86-63e0-4841-a78a-66b381cbfa33 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.757056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 271/527] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:37.758282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.781995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.782778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.783021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.783296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.784032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:37.784403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.785990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.810740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 257/528] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:37.811817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.897024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2880f-84ba-45ff-bd53-c92c160f2bb9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.927042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac768b-2eb6-47eb-bca4-f1e3b5f4f8e0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:37.944202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.945413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.945926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.946792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.947713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:37.948212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.950495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.964384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:37.965612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:37.965887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:37.966151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:37.968937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 272/529] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:37.970096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:37.973687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:37.978494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:37.980532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:37.997152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:37.998067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:37.998885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:38.005967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 258/530] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:38.006596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:38.008418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.095630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ca802-05fa-4e8d-bc16-5618bbb55996 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.122821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a066a-06e0-4f86-a28b-258127cd6b4c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.144019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.145558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.146312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.146776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.162978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.163891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.164359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.164873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.173187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.174819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:38.187187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:38.188012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:38.188850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:38.190987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 259/531] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:38.191917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.232448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.234055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.254108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:38.270602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:38.304953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be238328-bc07-43ad-980a-eaf0f4406bbd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.341433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.342351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.342862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.343323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.344263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:38.344835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.346501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.364476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 260/532] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:38.365757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.371787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 273/533] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:38.371787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.486609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa5c0-aaf2-434d-9639-5d7e1369c2b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.497900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bb843-ff29-4f5e-8410-e1213c54e274 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.505188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:38.529713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.530582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.530867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.531137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.532243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:38.532551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.534377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.537190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:38.550693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.551584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.552049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.553508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=f68ebccd64bc49d8a6c6d05d50ce2b6c) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:38.554040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.554825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 261/534] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:38.556286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.560677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.572956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 274/535] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/role_assignments?user.id=f68ebccd64bc49d8a6c6d05d50ce2b6c&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:38.574384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.688313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a5d0f-7b59-472f-8cf3-4cfe6e08a197 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.737727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.738380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.738661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.738929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.764113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.765616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.784708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72671223-de15-4e84-a314-fa9dd43d4569 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:38.805470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:38.806418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:38.807234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:38.807234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:38.807234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:38.807804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 262/536] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:38.813603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:38.844503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:38.845265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:38.845547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:38.845811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:38.846541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=83cabf530a454894816fbc457fa9a808) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:38.847553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:38.849013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:38.851420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:38.857496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 275/537] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/role_assignments?user.id=83cabf530a454894816fbc457fa9a808&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:38.979102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a12da-72cf-465e-9d3e-f8f664d9dd64 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:39.039111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:39.039981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.040405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.040837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.041652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:39.042115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:39.043662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:39.067800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 263/538] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:39.069104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:39.160593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:39.216031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffa799-b015-4213-9e8b-335dd9478a4f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:39.264598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:39.265471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.265890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.266299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.277170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:39.279567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:39.291954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:39.293070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:39.294046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:39.295722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 276/539] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:39.301502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:39.414562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:39.433323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3ba83-13ec-41fb-a3c4-47936285948c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:39.487791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:39.488404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.488682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.488976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.489668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:39.489969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:39.491383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df057d16-a168-4d86-b38c-358e32a9dcb3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:39.509149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 264/540] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:39.514309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:39.603801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e3a0-f354-4b66-a96c-bcec18c17acd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.604156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e3a0-f354-4b66-a96c-bcec18c17acd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.604345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977e3a0-f354-4b66-a96c-bcec18c17acd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.608882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 265/541] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:39.614491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caad6e7-a977-49c2-b759-da8b463d87c3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.614777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caad6e7-a977-49c2-b759-da8b463d87c3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.615049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caad6e7-a977-49c2-b759-da8b463d87c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.643249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098596b8-f0d3-4e5d-8b5b-bab8fa4d9d01 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:39.657804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0caad6e7-a977-49c2-b759-da8b463d87c3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:39.659020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0caad6e7-a977-49c2-b759-da8b463d87c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:39.661202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:39.679476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:39.680190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:39.680598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:39.680941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:39.681844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=31cab6d1bf8e41c49643a3f80c7703f1) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:39.682584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:39.684367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c44592-2433-4a55-bc72-2f4dd10bf775 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:39.696811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 277/542] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:39 2022] GET /identity/v3/role_assignments?user.id=31cab6d1bf8e41c49643a3f80c7703f1&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:39.755398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 266/543] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:40.040849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6626f-3239-40de-8fb4-a07af918b931 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:40.041200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6626f-3239-40de-8fb4-a07af918b931 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:40.041370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6626f-3239-40de-8fb4-a07af918b931 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:40.043490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 278/544] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:40.048677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:40.049003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:40.049279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:40.073487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:40.074778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:40.155726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6626f-3239-40de-8fb4-a07af918b931 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:40.163707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 267/545] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:40.318579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6626f-3239-40de-8fb4-a07af918b931 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:40.367254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:40.367875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:40.368149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:40.368415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:40.382519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:40.388376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:40.389276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:40.390035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:40.391749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 279/546] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:40.397851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:40.410088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:40.453199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:40.525112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:40.583946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec87d6f-26f9-44b8-af98-3b251f2ed195 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:40.586417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483268c7-1554-4fd6-8b3d-c469d73a9699 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:40.629363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:40.629363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:40.629363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:40.629363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:40.633494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:40.639379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:40.640388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:40.641232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:40.643846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 280/547] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:40.649519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:40.661684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:40.662305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:40.662575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:40.662851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:40.663531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:40.663834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:40.665229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:40.691277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 268/548] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:40.696805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:40.822678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d03aa-663d-4cb2-9178-056c734fc7e3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:40.832451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:40.861515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:40.862595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:40.862874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:40.863141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:40.863867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:40.864169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:40.866106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:40.875610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 281/549] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:40.880609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:40.921148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:40.976914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5a631-3be7-44fe-8179-2f6825444b14 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.024804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.025448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.025721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.025983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.029100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9f014-e4d1-45ac-ad74-730b54c530d9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.045901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.047443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.063382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.064008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.064284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.064554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.077180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.078718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:41.079000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:41.079931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:41.081056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:41.081056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:41.081056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:41.081056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 269/550] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:41.090248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:41.094300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:41.095171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:41.096220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:41.096220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:41.096220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:41.096220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 282/551] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:41.107047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.135178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:41.296435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a15875-8fa5-4224-ab4a-2d2b9c45ed0c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.297314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b517b-e8d5-45c7-b3b3-a3f53f972171 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.321778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:41.331438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.332039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.332409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.332684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.333359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:41.333666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.335102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b6f30-fa60-476b-b6d0-61da4c3c0c7e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.335798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.336596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.337009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.337427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.338160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:41.338558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.340277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.351891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 283/552] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:41.353204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac40d6-fbf5-4030-82e9-08ad27a24ee6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.353491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac40d6-fbf5-4030-82e9-08ad27a24ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.353617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 270/553] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:41.353823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac40d6-fbf5-4030-82e9-08ad27a24ee6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.355405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.355641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 284/554] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:41.358972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac40d6-fbf5-4030-82e9-08ad27a24ee6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.446423 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:41.478898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d63bfb-f287-4221-b0e6-d1aa617a0eb8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.479368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac40d6-fbf5-4030-82e9-08ad27a24ee6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.518778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.519819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.520400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.520916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.522356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.523064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.523343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.523613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.531611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.533859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.534106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.535647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:41.550646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:41.551620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:09:41.552523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e1c24f70-9b05-460e-b5ab-1666f85c8bf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:41.553561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:41.554500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:41.555873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:41.563315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 271/556] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:41.563315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.563315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.563315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.563826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 285/556] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:41.564929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.582612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:41.584293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:41.632412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:41.670031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 272/557] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:41.670871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.690617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1e472-3e48-41d6-8e97-55a400194732 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.729804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.730840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.731183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.731632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.733077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:41.733386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.735185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a9d0f-a3b1-4086-89de-3d810dddf547 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.737713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:41.759006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 286/558] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:41.760548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d8d7-1394-4ff6-9b21-4da80310f1c4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.760870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d8d7-1394-4ff6-9b21-4da80310f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.761149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d8d7-1394-4ff6-9b21-4da80310f1c4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.764923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 287/559] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:41.765987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d8d7-1394-4ff6-9b21-4da80310f1c4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.793464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0cb06-3fc7-4071-ab61-27690d41d3c2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.842496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.843112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.843395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.843655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.844861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:41.845175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.846878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eee92-f684-4028-8b9f-8208481558c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.869484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 273/560] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:41.870627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.871512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.871797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.893767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:41.895481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:41.906621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d8d7-1394-4ff6-9b21-4da80310f1c4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:41.925273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:41.958916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:41.959966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:41.960294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:41.960567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:41.974959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:41.976495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:41.978664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 274/561] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:41.979979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:41.999018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:41.999976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:42.000864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:42.000864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:42.000864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:42.001446 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 288/562] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:42.002040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.052744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.099917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c4197-ab15-403e-8366-257b327535a2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.112445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a8c9f-c96a-45cd-a231-2664aa94c466 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.148406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8aa6-a291-48cc-826c-24af010c7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.148926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.149126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8aa6-a291-48cc-826c-24af010c7679 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.149309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8aa6-a291-48cc-826c-24af010c7679 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.149582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8aa6-a291-48cc-826c-24af010c7679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.149781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.150118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.150447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.161568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:42.166894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:42.169673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 289/563] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:42.171620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.181666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.229873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8aa6-a291-48cc-826c-24af010c7679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.233334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8aa6-a291-48cc-826c-24af010c7679 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.273705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1ba3-4906-49d8-a780-dd2da6ef3d7d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.275980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.307777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.308798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.308798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.309070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.309680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:42.309982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.311345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.322841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 290/564] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:42.323626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.333303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 275/565] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:42.334536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754fadf-6eba-4056-9aea-0024ffc82221 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.334815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754fadf-6eba-4056-9aea-0024ffc82221 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.335088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754fadf-6eba-4056-9aea-0024ffc82221 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.336306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 276/566] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:42.337014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754fadf-6eba-4056-9aea-0024ffc82221 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.397276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.426391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7a3f-ad46-4ca8-8e6a-0f38ffa8a4b4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.439080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754fadf-6eba-4056-9aea-0024ffc82221 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.460236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.460866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.461140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.461404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.462061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:42.462358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.463701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.471703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 291/567] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:42.472020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.472470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.472635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.472940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.473206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.486575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:42.491209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:42.492298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 277/568] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:42.493182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.508922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.579580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadf1cf-76ed-43d0-9b00-83bc29cdf503 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.590695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2e4e3-7648-4da3-8ad4-334d7f80c53f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.610400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.613062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.613778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.614067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.614335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.620799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.622587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.624991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.625738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.626010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.626275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-713efa5d-75a7-4545-92ad-1e39868c9e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:42.633519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:42.634483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:42.635354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 292/569] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:42.635935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.636162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.636431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.639096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.640526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.655775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:42.656990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:42.657399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:42.658346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:42.659218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:42.659218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:42.659218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:42.659218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 278/570] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:42.659218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.736336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 293/571] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:42.737076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.753239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.778050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f0f4-2b55-4e2a-9a5f-5e039ef57045 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.822001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.822702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.823047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.823380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.835421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.836971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.837966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f00a-4795-4aab-9d9d-4822ed7cc9fa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:42.852106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:42.853106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:42.853990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:42.853990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:42.853990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:42.853990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 279/572] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:42.854242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.878214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:42.878812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:42.879087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:42.879352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:42.880017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:42.880318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:42.880832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.881862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:42.891563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 294/573] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:42.892221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:42.965193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd29d-dce5-4772-9f9d-c187e9d95383 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:42.975060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:42.999805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ca350-91c1-4613-9856-9faa425c7436 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.002218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.002940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.003315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.003682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.004468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.004941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.006580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.019661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 280/574] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.020530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.039109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.039701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.039976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.040242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.040916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.041222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.042572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.053952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 295/575] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.054721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.102187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.117932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407565c-98df-413c-a3e8-2f9b95272832 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.151200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.151795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.152589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.152691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb5e3d-c7ba-4792-8076-a04d17627d57 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.153007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.153644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.153945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.155292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.166149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 281/576] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.166930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.186153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.186778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.187049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.187317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.193660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.197814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.199804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:43.214447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:43.215572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:43.216658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:43.216658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:43.216658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:43.216658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 296/577] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:43.216952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.272998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4c087-5c0a-41f4-987f-78f37fd1f2a5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.305549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.306171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.306452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.306722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.316539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2c26-44ba-4efb-8952-4dab2e706be7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.317028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:43.322149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:43.323274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 282/578] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:43.324289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.328473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.351989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.352715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.353078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.353411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/a5e487f1b5af4aa0a2d922d374adc29f/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.368811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=a5e487f1b5af4aa0a2d922d374adc29f, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.370252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.382697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 297/579] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:09:43 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/a5e487f1b5af4aa0a2d922d374adc29f/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:43.383589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.441825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.442422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c94fd-dff9-4e85-80b7-422790e78eb2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.484968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.485869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.485869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.486172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.494328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.495777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:43.508577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:43.509582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:43.510587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 283/580] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:43.512015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.522347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158ee1-44e5-48b7-87c7-0e2870ac4c5c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.570724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.571451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.571824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.572137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.579792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.581610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.587061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:43.594345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:43.595299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 298/581] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:43.596900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.635141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad355c-17a3-4168-bc95-b34f7e9fe2d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.672495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801208-7790-4959-a563-8bf54df181fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.673230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801208-7790-4959-a563-8bf54df181fd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.673513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801208-7790-4959-a563-8bf54df181fd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.673785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801208-7790-4959-a563-8bf54df181fd None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.674440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801208-7790-4959-a563-8bf54df181fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.674741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801208-7790-4959-a563-8bf54df181fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.676104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11801208-7790-4959-a563-8bf54df181fd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.688979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 284/582] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.688979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801208-7790-4959-a563-8bf54df181fd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.706238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.710140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b90800-f663-43bd-b11d-908af7f51d48 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.749015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.749618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.749889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.750156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.750823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.751116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.752472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.760615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 299/583] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.761469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.809393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801208-7790-4959-a563-8bf54df181fd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.833587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.847457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.848075 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.848421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.848750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.849530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.849894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.851366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.864429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 285/584] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.865350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.872168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2c8fb-29c0-46f2-bbee-3bc89b8f0894 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:43.906905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:43.907505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:43.907773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:43.908037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:43.908753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:43.909080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:43.910618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:43.927749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 300/585] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:43.928546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:43.952109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:43.977015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644719-7b49-4f23-a6ac-87d4a86bc388 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.014495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.015130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.015403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.015675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.023167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.024596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:44.035676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:44.036825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:09:44.037986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:44.038623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c1c4e-0755-4b0e-8c58-d0065554244b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.041553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 286/586] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:44.042428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.079791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.081064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.081568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.082028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.089507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.097115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.098560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:44.113866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:44.114859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:44.115779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:44.115779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:44.115779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:44.115779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 301/587] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:44.116572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.155218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6fff5-a757-404c-9d0c-db19aac02cc7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.189237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.189840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.190131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.190382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.191284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=8f582fce261d42b185ad05f699cf1f00) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:44.191397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.191988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.193229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.208062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 287/588] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/role_assignments?user.id=8f582fce261d42b185ad05f699cf1f00&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:44.208062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.243709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f20f-6a0a-405f-a883-f455d0a22b59 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.292749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.294506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.294785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.295053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.310266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46cf16-84fc-4916-9941-d45aa8bb8f3f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.310508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.312094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.320512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:44.333166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:44.334472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:44.335361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:44.335361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:44.335361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:44.339029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 302/589] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:44.341196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.356372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.357415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.357950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.358219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.358986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:44.359264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.360904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.385875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 288/590] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:44.385875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.472508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34beed9-7be7-47ba-ba26-9af33c2a850a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.495693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33ebe2-032a-4fa6-af05-b56371f3c859 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.499057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.511498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.512366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.512816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.513208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.513960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:44.514385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.515948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.535004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 303/591] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:44.535004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.538542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.539322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.539760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.540174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.540993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:44.541464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.543540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.560377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 289/592] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:44.561299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.590993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.656438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8fcd1-4ac4-4606-a626-29014105626b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.686548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4c3b2-6565-4a30-9dd0-6969d6352b1e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.694199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.695147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.695644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.696136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.707454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.709438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.725648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.726277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.726553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.726823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:44.728366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:44.729338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:44.730903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:44.730903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:44.730903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:44.733277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 304/593] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:44.734343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.740123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.741585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:44.758267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:44.759247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:44.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 290/594] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:44.760755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.776107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.854681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89372d0b-cabe-4a96-be37-90c697163510 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.857384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:44.874425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1a3e5-1518-4f25-a4f2-089f31dbec5a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:44.890195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.890966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.891341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.891709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.898736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.900554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.911630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:44.912446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:44.912914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:44.913327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:44.914148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:44.914590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:44.915182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:44.916223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:44.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:44.918718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 305/595] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:44.919729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:44.919928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:44.934109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 291/596] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:44.935577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.018454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.024416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540fbd2-6df3-40c4-bafa-b96fa86dd60e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.047819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a180fa-bdfb-4f90-befd-074ea4543162 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.061258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.061977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.062370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.062625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.063434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:45.063805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.065356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.083699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 306/597] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:45.084440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.087918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.088801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.089293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.090292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.091163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:45.091653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.093322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.106772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 292/598] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:45.108040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.117843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.207206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a804d1-92fa-435e-bfe7-66cf1d978390 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.236802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4399c31-c870-476b-8090-40fabca83fb4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.252717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.253862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.254315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.255262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.264324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.266278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:45.283070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:45.283973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:45.284863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:45.285294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.285294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.285294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.285294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.288181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 307/599] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:45.289268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.301555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.303099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.309390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:45.326293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:45.327476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:45.328424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:45.328424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:45.328424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:45.328424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 293/600] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:45.328654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.399105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.417085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea54ae3-7549-42a6-ac21-9673ff6ea4f0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.453488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.453886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5892-1581-402c-9c55-9854915ac06c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.454451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.454820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.455180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/f68ebccd64bc49d8a6c6d05d50ce2b6c/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.471717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=f68ebccd64bc49d8a6c6d05d50ce2b6c, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.473354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.498034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.498406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 308/601] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:09:45 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/f68ebccd64bc49d8a6c6d05d50ce2b6c/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:45.499146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.499571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.499687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.500265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.501230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:45.501689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.503464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.519287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 294/602] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:45.525300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.641200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.645555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691c44-1711-47a8-9458-03db09b82eba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.667383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:45.687358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428ab42-2f67-424f-a221-c3dd91369fb0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:45.692225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89000c6-304e-45fc-a012-007c22551fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.693267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89000c6-304e-45fc-a012-007c22551fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.693751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89000c6-304e-45fc-a012-007c22551fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.694296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89000c6-304e-45fc-a012-007c22551fb7 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/83cabf530a454894816fbc457fa9a808/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.713685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89000c6-304e-45fc-a012-007c22551fb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=83cabf530a454894816fbc457fa9a808, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.716270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89000c6-304e-45fc-a012-007c22551fb7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.727664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:45.728256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.728543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.728926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.729877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:45.730876 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:45.732501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cbec9-6784-4839-804f-81260d5d6a68 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:45.740950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 295/603] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:09:45 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/83cabf530a454894816fbc457fa9a808/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:45.742774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379c024-2834-444f-bfe7-a81614faedaf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.743324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379c024-2834-444f-bfe7-a81614faedaf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.745372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379c024-2834-444f-bfe7-a81614faedaf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.746551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 309/604] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:45.748045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 296/605] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:45.754149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:45.754377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379c024-2834-444f-bfe7-a81614faedaf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:45.754661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:45.755054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:45.784602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:45.786083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:45.861493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 310/606] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:45.954238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379c024-2834-444f-bfe7-a81614faedaf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:46.003494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:46.004041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.004373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.004648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.012565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:46.014180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:46.026151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:46.027761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:46.029524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 297/607] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:46.035948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:46.097730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:46.153214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9bbfe-418b-4049-9691-bca127e62e7c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:46.197501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:46.198103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.198374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.198639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.199924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:46.200274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:46.201755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:46.214317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:46.220595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 311/608] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:46.226993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:46.286240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:46.363033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81795f-337b-421c-91ad-d2cd34c9c0b8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:46.394361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:46.445487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9f4f7-c422-4add-adfe-3d73900963d1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:46.463959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5047-9b46-48e7-bc8d-60fee1478c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:46.465675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5047-9b46-48e7-bc8d-60fee1478c43 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.466184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5047-9b46-48e7-bc8d-60fee1478c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.466678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5047-9b46-48e7-bc8d-60fee1478c43 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/31cab6d1bf8e41c49643a3f80c7703f1/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.493805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5047-9b46-48e7-bc8d-60fee1478c43 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=31cab6d1bf8e41c49643a3f80c7703f1, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:46.497065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5047-9b46-48e7-bc8d-60fee1478c43 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:46.502218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd37e-f268-4ddf-acab-332e50a79b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:46.502845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd37e-f268-4ddf-acab-332e50a79b94 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.503116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd37e-f268-4ddf-acab-332e50a79b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.503384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd37e-f268-4ddf-acab-332e50a79b94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.529083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 312/609] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:09:46 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/31cab6d1bf8e41c49643a3f80c7703f1/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:09:46.530227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefd37e-f268-4ddf-acab-332e50a79b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-efefd37e-f268-4ddf-acab-332e50a79b94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:46.535288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:46.536236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:46.537143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:46.538273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f363650-e827-4bf5-aa27-935a40fa1dc3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.538444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f363650-e827-4bf5-aa27-935a40fa1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.539010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f363650-e827-4bf5-aa27-935a40fa1dc3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.540310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 313/610] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:09:46.540568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 298/611] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:46.543556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f363650-e827-4bf5-aa27-935a40fa1dc3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:46.550291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.550647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.550858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.583712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:46.584927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:46.697946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f363650-e827-4bf5-aa27-935a40fa1dc3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:46.734635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 299/612] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:46.741861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:46.742452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.742722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.742984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.743707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:46.743999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:46.745400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:46.758158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 314/613] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:46.764048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:46.803687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:46.879654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b896ac7-c74b-44c2-b502-2ac57bc89c14 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:46.922719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:46.923798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:46.924274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:46.924789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:46.939215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:46.940945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:46.956276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:46.957259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:46.958164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:46.958164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:46.958164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:46.960341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 300/614] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:46.966492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.000733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:47.051676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.154874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42211-a267-4503-8af6-c3ab3969feb6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:47.158840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:47.214701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cf04-088b-48c3-bc8f-32ea7cddb86c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:47.217829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:47.218427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:47.218694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:47.218954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:47.219592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:47.219884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:47.221282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:47.247610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 315/615] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:47.257728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.290012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:47.290646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:47.290925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:47.291195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:47.313735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:47.327861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:47.328847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:47.329691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 301/616] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:47.335112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.342497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:47.358095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd1c8-9792-417c-a763-405b78e4d913 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:47.425737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:47.426285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:47.426557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:47.426823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:47.440695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:47.442171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:47.468162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:47.469492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:47.470664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:47.474543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 316/617] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:09:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:47.482599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.576912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517a026-3b21-47d2-8440-13a1077ffc49 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:47.599377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2f076-57b9-421a-9da0-057e2e1a9be1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:47.637106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:47.638176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:47.638455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:47.638727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:47.639457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:47.639754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:47.641226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:47.666632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 317/618] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:09:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:47.671989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:47.672991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.677043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:47.680537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:47.681383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:47.681732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:47.682150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:47.682890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:47.683846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:47.694173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:47.711161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 302/619] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:47.717169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:47.783022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87bd8f-0670-4eb1-a126-ac230d8bbcd5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:47.821168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410a44-84df-45e8-a9f2-bb2afa7ae1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:47.821778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410a44-84df-45e8-a9f2-bb2afa7ae1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:47.822053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410a44-84df-45e8-a9f2-bb2afa7ae1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:47.822368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410a44-84df-45e8-a9f2-bb2afa7ae1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:47.904173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410a44-84df-45e8-a9f2-bb2afa7ae1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:47.905861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410a44-84df-45e8-a9f2-bb2afa7ae1a5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:47.913189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:47.997704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087096d-3307-4524-a7ef-1bf5abef3d61 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.056550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.057587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.058060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.058831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.070190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.071941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.081236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 318/620] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:48.082565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba3fd-1c40-4e7a-bbbb-559e3e2fb381 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.082850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba3fd-1c40-4e7a-bbbb-559e3e2fb381 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.083121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ba3fd-1c40-4e7a-bbbb-559e3e2fb381 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.084824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 319/621] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:48.086135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba3fd-1c40-4e7a-bbbb-559e3e2fb381 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cec1f36f-c382-4756-90a7-54f7d1487aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:48.093857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:48.094858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:48.095737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:48.095737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:48.095737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:48.099852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 303/622] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:48.101385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.101541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.101775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.122736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:48.124018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:48.166514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.198296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ba3fd-1c40-4e7a-bbbb-559e3e2fb381 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.201301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.205304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 304/623] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:48.206703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.237784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.238810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.239296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.239770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.251357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.253133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:48.268516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:48.269655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:48.270567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:48.270567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:48.270567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:48.272598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 320/624] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:48.281728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.364037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac33292-b3f5-466d-87ab-c5e11068a026 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.401522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.402794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.403197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.403646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.404479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:48.404809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.406181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.434562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 305/625] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:48.438314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b95e-a074-441d-a320-6d0a0768d32d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.441275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.489621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.495012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.501568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.501957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.502296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.503069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:48.503472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.504972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.526482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 321/626] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:48.532228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.563211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9abf-68fd-43a2-aca4-d31eebbec04d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.569180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.600872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.601585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.601924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.602258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.610339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.611758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:48.623283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:48.624484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:48.625472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 306/627] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:48.626089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.671249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d109a-7628-45be-9b8d-34271eb13050 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.707424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.708044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.708315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.708580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.715757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.717227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-20e0f175-aef2-4987-977b-1a0f90ac6b4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:48.728420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:48.729653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:48.731506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:48.734952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 322/628] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:09:48.736090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa7e4-9e8e-4d52-b662-7afa08d4622d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.736371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa7e4-9e8e-4d52-b662-7afa08d4622d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.736637 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa7e4-9e8e-4d52-b662-7afa08d4622d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.737903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 323/629] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:48.738668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa7e4-9e8e-4d52-b662-7afa08d4622d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.757216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.765355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea68d86-0096-4437-9fdd-7a73b304b12a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.805684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.806648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.806934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.807468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.820054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:48.825632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:48.826599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:48.827434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 307/630] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:48.828171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:48.832357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:48.861793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa7e4-9e8e-4d52-b662-7afa08d4622d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.901263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.902441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.902648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.902951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.903638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:48.903933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.905398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a1db8-b3f1-4e0d-a57d-801ba0510cf0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.923394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 324/631] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:48.924379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.924658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.924989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.939654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf4755-17d4-47bc-a407-629ec8efde17 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:48.945379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:48.946945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:48.973849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:48.974455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:48.974737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:48.975014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:48.975696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:48.975999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:48.977435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:48.996439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 308/632] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:48.996439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.012066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.032813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 325/633] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:49.032813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.113687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.128427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff113-1404-43e7-a9f6-2e538ff10aab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.154123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f72a4-57bd-4d9a-91eb-0c930f5b9323 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.173050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.173805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.174172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.174534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.175349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:49.175742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.177236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.196793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 309/634] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:49.196793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.218870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.219518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.220050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.220322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.234683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.236546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5f269c67-703a-48b8-a1e4-5e9a9fc2c3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:49.256350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:49.257599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:49.258709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:49.258709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:49.258709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:49.258709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 326/635] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:49.259010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0b457-f249-41fb-b6a4-cbc87d1827c7 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.259010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0b457-f249-41fb-b6a4-cbc87d1827c7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.259295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0b457-f249-41fb-b6a4-cbc87d1827c7 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.261400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 327/636] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:49.262252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0b457-f249-41fb-b6a4-cbc87d1827c7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.279138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.312099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90976-80b1-4617-8e13-2999d7b22958 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.350562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.351417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.351844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.352260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.353194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=a5e487f1b5af4aa0a2d922d374adc29f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:49.353679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.355782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b3eb1-a0b6-4ec9-8e76-99eb9ef74eb9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.362783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 310/637] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/role_assignments?user.id=a5e487f1b5af4aa0a2d922d374adc29f&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:49.363983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.364269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.364819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.382112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0b457-f249-41fb-b6a4-cbc87d1827c7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.392935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:49.394166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:49.402364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.426811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.427587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.427934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.428274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.441926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.443524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:49.461276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:49.462327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:49.463295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:49.463295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:49.463295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:49.467720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 328/638] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:49.468549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.482344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 311/639] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:49.483624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.595751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.642722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a2732-8377-4c14-ae70-bc102a0cc6da None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.653935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035fc7d-37ba-476a-afb2-2b12c03a18c3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.686877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.687484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.687756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.688022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.688661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:49.688988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.690344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.705323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 329/640] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:49.707174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.710493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.711666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.713106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.713582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.728533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:49.735972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:49.736971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:49.737795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:49.740820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 312/641] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:49.741920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.745102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.832798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c281ee0-36f9-4aaa-a697-b361267583be None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.859124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9877-e319-4635-b8bb-701c61d138e8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:49.869054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.869662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.869937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.870211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.871020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:49.871325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.872690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.884524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 330/642] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:49.885349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.894728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:49.903275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:49.903903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:49.904177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:49.904443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:49.911266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:49.912703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:49.924644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:49.925661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 313/643] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:49.926549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:49.988060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.000765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758277-6e2b-4237-8dee-353d0216bfda None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.037191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39b20-f99a-4119-a1ce-cba1aaf1a6f1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.037974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.038898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.039477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.039745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.040408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:50.040706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.042094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.055385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 331/644] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:50.055385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.077002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.077628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.077905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.078172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.088400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:50.094099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:50.095009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 314/645] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:50.095973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.155844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.164980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ff9ab-3a30-4485-b354-ce2ef49d9b70 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.200901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.201792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.202069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.202320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.210262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b56dc7-720c-419e-8a7a-824d25be1a71 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.211500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.213398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:50.224948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:50.225903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 332/646] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:50.226849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.240076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.251802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.252409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.252702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.252987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.253676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:50.254069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.255388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.272604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 315/647] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:50.272604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.337506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92351-aeb7-4412-9e82-cd18efd43652 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.374271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.374907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.375186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.375453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.378542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1feb4f-141b-46c9-9f47-20748fd434f0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.386795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.388805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.389344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:50.406117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:50.407201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:50.408066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:50.408066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:50.408066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:50.408066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 333/648] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:50.408813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.427064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.427664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.427938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.428200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.428877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:50.429173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.430535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.440199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 316/649] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:50.441049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.478553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.521638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2e27e-1e64-401d-9c79-780e61453152 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.544015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f51c4-fd38-40d4-afbb-4eeb8ae86219 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.555339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.555934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.556213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.556479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.557240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:50.557540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.559667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.577356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 334/650] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:50.578163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.586323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.587203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.587694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.588128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/8f582fce261d42b185ad05f699cf1f00/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.603234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=8f582fce261d42b185ad05f699cf1f00, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.604911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.619565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 317/651] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:09:50 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/8f582fce261d42b185ad05f699cf1f00/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:09:50.621823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.663486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.691786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45d4a1-8eb6-46dd-bb8c-7966445b6c90 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.719418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.740092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.740912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.741264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.741854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.742604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:50.743051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.745007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.760567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0e1df-92dd-4c2a-9ebf-cc7dfb86fac4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.764929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 335/652] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:50.766099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.814913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.815550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.815851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.816098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.829150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:50.830584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:50.846539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:50.847514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:50.849178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:50.849178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:50.849178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:50.849178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 318/653] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:50.849178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:50.904019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773341ca-705a-44b3-aecb-c679abd27fa6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.943193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:50.943689 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:50.943952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:50.944222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:50.952922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:50.989135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9da8b-ee35-44b4-92dc-c52a06c1f2f2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:50.998013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.019251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.020748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.037673 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.038435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.038716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.039244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.049755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.052071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:51.067241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:51.068219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 319/654] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:51.070187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.144872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 336/655] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:51.145802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.196500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a62e6a-550b-4f93-9c52-21a97924330a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.236855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.237859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.238409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.238677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.239318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:51.239614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.240190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.242911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.245220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.262995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 320/656] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:51.264111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.267565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efc32e-f437-4f72-aae2-79a215e1c633 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.314633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.315379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.315750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.316123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.317362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:51.317767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.319903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.347855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 337/657] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:51.347855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.397587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096c8a-ed61-4cc4-9d08-6dcd029716fe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.444266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.445268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.445711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.446249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.460306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.462833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.469903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8de052-f0ef-4eac-9a6c-82377f8c594c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:51.487008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:51.488162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:51.489283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:51.489283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:51.489283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:51.491397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 321/658] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:51.492416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.517102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.517877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.518253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.518616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.528903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.530854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.533298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.547892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:51.548624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:51.549804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 12:09:51.550957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:51.556812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 338/659] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:51.556812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.634824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37234a22-896a-4863-bbe2-c4f92d7e982d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.673589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3610-a69f-4d10-950b-ca9b1e65ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.674470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3610-a69f-4d10-950b-ca9b1e65ef8e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.674470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3610-a69f-4d10-950b-ca9b1e65ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.674739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3610-a69f-4d10-950b-ca9b1e65ef8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.700523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98acac5-177b-4813-95bc-e2f2f8638d86 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.735932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.736820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.737278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.737543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.738174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:51.738470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.739834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.745451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3610-a69f-4d10-950b-ca9b1e65ef8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.747625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3610-a69f-4d10-950b-ca9b1e65ef8e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.755995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 339/660] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:51.755995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.799237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.815757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:51.859895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00ae5-bbad-495e-a9a0-ea35ca2d97f1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:51.866055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 322/661] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:51.866055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14577-1021-427d-bead-be6d2ad2fcca None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.866055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14577-1021-427d-bead-be6d2ad2fcca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.866055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14577-1021-427d-bead-be6d2ad2fcca None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.866055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 323/662] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:51.866055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14577-1021-427d-bead-be6d2ad2fcca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.903335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:51.903929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:51.904206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:51.904747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:51.905219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:51.905522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:51.906959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:51.926618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 340/663] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:51.927441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:51.976514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14577-1021-427d-bead-be6d2ad2fcca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.012726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.013295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.013568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.013830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.020662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.022117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-199f0c45-4ce2-4d44-9482-7d47a42ce391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:52.033377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:52.034469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 324/664] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.035829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.036453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.041749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a519f-7904-41ed-a946-37df386df5e7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.049423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.056135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:52.057351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:52.060956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.082740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.083341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.083618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.083880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.094706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.096138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:52.111320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:52.112252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:52.113171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:52.113171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:52.113171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:52.113171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 341/665] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:52.114002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.135757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 325/666] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:52.137859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.226981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db8c28-7935-4cc2-90f5-0981ac166b72 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.265452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.265975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.266250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.266520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.281334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbab492-e222-4cc4-9fc8-13e8b8f0c92b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.307817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.333535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.335154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.335641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.336355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.337541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:52.337847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.339332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.342678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.348597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.350323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.354087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 326/667] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:52.355468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.470944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 342/668] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:52.471623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.482323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e36ea-0201-4538-b092-50fb3f8f6214 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.518066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.518589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.518865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.519136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.519772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:52.520070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.521445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.536267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 327/669] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:52.537116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.546693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.582052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2a9c-d950-48af-893a-36c08814832c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.601048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.618209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.618808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.619080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.619348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.620073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=f68ebccd64bc49d8a6c6d05d50ce2b6c) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:52.620377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.622517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.636815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 343/670] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/role_assignments?user.id=f68ebccd64bc49d8a6c6d05d50ce2b6c&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:52.636815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.660623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44fe67-04eb-420a-add2-845f26756e40 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.701565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.702309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.702658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.702996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.716212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:52.721737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:52.722924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:52.723963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:52.725507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 328/671] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:52.726449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.770629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b4ad-755f-40b1-af2a-9aa69d274b6e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.805133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.816579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.817257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.817532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.817798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.835787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.837289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:52.853141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:52.854208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:52.855122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:52.855122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:52.855122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:52.855900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 344/672] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:52.856433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.871426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76051de9-2b86-4718-8cb3-c12b35e6a35b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:52.894636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:52.919495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:52.920503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:52.921006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:52.921484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:52.929636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:52.931055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:52.947006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:52.947948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 329/673] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:52.955300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:52.975245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0fd76-1768-488a-b177-592687e16a76 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.011883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.012623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.012927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.013186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.013840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:53.014136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.015486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc24c4-b6b1-43a8-a0dc-5098aa6d09ba None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.029008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 345/674] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:53.030180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9c517-e65c-4088-9f75-b77f0ee352af None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.030461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9c517-e65c-4088-9f75-b77f0ee352af None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.030785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9c517-e65c-4088-9f75-b77f0ee352af None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.032454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 346/675] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:53.033035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9c517-e65c-4088-9f75-b77f0ee352af None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.065553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0255e2-f81a-40a4-936f-6c518bf2e9ac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.084985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.101122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.101732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.102008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.102273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.102907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:53.103205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.104559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.116056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 330/676] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:53.116890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.147899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9c517-e65c-4088-9f75-b77f0ee352af None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.154637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.185120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.186396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.186840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.187245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.188068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:53.188507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.190098 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b440e5a-581a-452f-86cb-d2f14ab8e3db None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.204177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 347/677] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:53.205973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.206416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.206821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.226006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c4e82-61bf-47e3-8f0b-fb42a9d86575 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.227648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:53.229066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:53.259137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.259770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.260046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.260312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.271776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.273251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:53.287775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:53.288932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:53.289809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:53.289809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:53.289809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:53.289809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 331/678] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:53.290055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.302972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 348/679] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:53.303984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.368543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.396060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.410848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfba40-1e43-417d-bc1f-a58cac2b0b3b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.445030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e4e18-6550-4d37-95d7-61079eabdef5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.447863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.448698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.449187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.449604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.457723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.459454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:53.474250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:53.475313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:53.476411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:53.478671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 332/680] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:53.479697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.485223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.485939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.486306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.486666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.487488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=83cabf530a454894816fbc457fa9a808) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:53.487886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.489446 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.496202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 349/681] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/role_assignments?user.id=83cabf530a454894816fbc457fa9a808&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:53.497190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.599496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870aa5-38c3-49a1-9968-8357c6dfd748 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.605640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.614624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc220b-d899-4c74-b887-cced1b6cff39 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.644867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.645518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.645794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.646117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.646881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:53.647174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.648715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.657063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.658044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.658549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.659019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.659948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:53.660469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.662163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.668196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 333/682] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:53.668196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.682174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.693022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 350/683] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:53.694386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.783841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de3a7-e23d-4ba2-845e-d4d182f3113b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.818252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783865c-c766-4720-84ba-98d109e721a5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:53.837577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.839436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.839436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.839436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.851304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:53.857562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:53.858597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:53.859469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 334/684] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:53.860169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.866381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:53.867023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:53.867298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:53.867562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:53.875873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:53.877649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:53.890224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:53.891194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 351/685] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:53.892508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:53.927308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.940926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:53.981751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae39007-f034-4e10-90d2-9a831c3f12fd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.019995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.021003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.021502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.021774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.022510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=31cab6d1bf8e41c49643a3f80c7703f1) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:54.022818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.024249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.036919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 335/686] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/role_assignments?user.id=31cab6d1bf8e41c49643a3f80c7703f1&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:54.038151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.044316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eb18a-53db-4566-9970-bacea4db7e05 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.092380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.093644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.094864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.095514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.097634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:54.098396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.100748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.119789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 352/687] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:09:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:54.129878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.207367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42de2e-59a8-45ad-a645-6c0f9501858d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.241688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:54.262252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.262865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.263136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.263398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.264128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:54.264424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.265980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.287007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 336/688] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:54.297930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.298645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:54.320212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3eb2a-aa32-45d6-9913-9f62f4cd6ab5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.364660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.365731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.366030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.366305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.384155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.386257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:54.405363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:54.406360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:54.407256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:54.407256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:54.407256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:54.411560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 353/689] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:54.413113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.445678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3a4b0-bb5a-45af-93b5-68ba6933217f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.492375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.493604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.494223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.496512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.571561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:54.579645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2291003-cc66-4bb4-969f-77e8f6c8ffd6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.583141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.584586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.692672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 337/690] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:54.695941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.696565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.696945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.697219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.697877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:54.698180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.700492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.710043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.713224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:54.737574 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 354/691] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:54.742974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.876305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522c6b-c109-42f9-9ef5-0207960027da None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:54.901190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:54.913215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:54.914295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:54.914760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:54.915186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:54.927141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:54.928838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:54.945191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:54.946360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:54.947471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:54.947471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:54.947471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:54.949502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 338/692] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:54.957058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:54.962681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ac69e-f25a-493c-9f0e-5c2f92b134c9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.065495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.066136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.066368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.066641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.068739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3022a-67e8-4b25-834d-b8c289178a45 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.075226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.076673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.104675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.105681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.106185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.106658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.107494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:09:55.107614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:55.108487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:09:55.109473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:55.110838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.112408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6f387-b279-49ff-af73-30f326046b05 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.117212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 355/693] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:55.123538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.127020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 339/694] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:55.128556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbdfda-4821-4be8-914c-ee68debc9c46 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.129099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbdfda-4821-4be8-914c-ee68debc9c46 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.129573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbdfda-4821-4be8-914c-ee68debc9c46 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.131506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 340/695] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:55.132563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbdfda-4821-4be8-914c-ee68debc9c46 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.135656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.185698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.232591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50815a-698b-4a03-a35d-f7d48aa7a91d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.249930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbdfda-4821-4be8-914c-ee68debc9c46 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.267558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.268159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.268431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.268695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.269447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:55.269744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.271170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e33695-1ec8-4a7c-8882-a5b3416b8a7c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.287363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.288160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.288441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.288708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.294755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 356/696] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:55.296049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.296324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.296588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.296802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.298310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:55.312093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:55.313049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:55.314341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 341/697] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:55.317574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.319017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:55.320177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:55.387597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.404808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 357/698] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:55.404808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.451566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.468030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2234d6-d510-4413-a455-7a51cf36fc9f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.517785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ab66-2417-4745-aa48-547dd9063a99 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.532558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.533654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.534205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.534672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.558935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.559536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.559806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.560071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.560762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:55.563774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.565236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.592200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 358/699] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:55.599153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.651967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.654100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.725024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.771920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 342/700] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:55.778714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.820373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d81a2-04b6-498e-9277-069d72892b22 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.823785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:55.866094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.866878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.867247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.867621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.868466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=a5e487f1b5af4aa0a2d922d374adc29f) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:55.868932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.871517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.878159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 359/701] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/role_assignments?user.id=a5e487f1b5af4aa0a2d922d374adc29f&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:55.879149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:55.905761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225286-f463-4088-a8d6-8bb64f47058f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:55.956116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:55.957060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:55.957728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:55.958141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:55.976525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:55.978313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9e5de673-b93e-4c6b-b1ed-81a387cc6027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:55.999742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:56.001046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:56.001952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:56.001952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:56.001952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:56.002120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5737e3-32e6-4188-898f-d5f914deac8d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.009595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 343/702] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:56.013645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709051e-aabf-4b4d-bae8-fdc20a1b1620 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.014248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709051e-aabf-4b4d-bae8-fdc20a1b1620 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.015119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709051e-aabf-4b4d-bae8-fdc20a1b1620 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.017608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 344/703] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:56.019406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709051e-aabf-4b4d-bae8-fdc20a1b1620 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.042663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:56.047830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.048563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.048955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.049292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.049952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.051520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-184c39d4-6b45-40f3-97e2-fd66eea26e44 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:56.065029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:56.066582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:56.067457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 360/704] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 28 12:09:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:56.068253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.068253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.068381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.095515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:56.096992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:56.124811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:56.142569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709051e-aabf-4b4d-bae8-fdc20a1b1620 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.174644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 361/705] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:56.175589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.178201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.179968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.180500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.181040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.181945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:56.182445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.185387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.205852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 345/706] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:56.213921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.347296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:56.372596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90df22d-258b-4343-a2c1-a97a10488c61 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.397486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c680-a92d-4d3b-8a43-3e05978dc8d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.439495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.440206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.440477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.440736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.441391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:56.441684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.443244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.448122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 362/707] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:56.453595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.457760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.458417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.458698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.458970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.473762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.475327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.481236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:09:56.503204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:56.504151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:56.505060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 346/708] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:56.511985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.569098 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef612be3-27f2-487f-810b-dde4414d4da5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.613489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.614592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.615493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.616242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.617236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:56.617742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.619853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.624013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19e35-8181-447f-8a0f-9891627fa2f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.627924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 363/709] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:56.628971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.690319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.690936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.691209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.691472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.692175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:56.692470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.693903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.695803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:56.724760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 347/710] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:09:56.744247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:56.747053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.760387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae67c-37e1-4da9-889c-935181d17070 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.800174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.801215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.801492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.801761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.816818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.816818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:56.835121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:56.836139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:56.837146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:56.837146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:56.837146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:56.837146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 364/711] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:56.844821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:56.933751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e4b24-209f-439c-be74-aa5b4d08100c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.985755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:56.986278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.986550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.986810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.987523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=8f582fce261d42b185ad05f699cf1f00) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:56.987820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:56.989077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7332-8310-4c52-a98d-b5f8a90a436d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:56.989262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca86a0-0aa2-401e-b634-d713fd62836c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:56.995254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 348/712] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/role_assignments?user.id=8f582fce261d42b185ad05f699cf1f00&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:56.996536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324916a4-97ba-4160-93d1-a95203c54c3e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:56.996831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324916a4-97ba-4160-93d1-a95203c54c3e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:56.997106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324916a4-97ba-4160-93d1-a95203c54c3e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:56.999705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 349/713] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:57.005569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:57.005968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:57.006332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:57.029663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:57.030981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:57.036409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:57.037320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:57.037742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:57.038160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:57.039010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:57.039482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:57.041778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:57.056022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:57.060442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 365/714] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:57.068900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:57.099087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:57.115599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 350/715] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:09:57.240829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4abee7-21c0-479f-8ceb-0b1f0ecff853 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:57.279501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:57.280473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:57.281004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:57.281498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:57.282351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:57.283994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:57.307321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 366/716] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:09:57 2022] POST /identity/v3/users => generated 254 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:09:57.460530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:57.578346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7712733-cdb5-4c34-9dc0-18cdfae0d200 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:57.615986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:57.617037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:57.617525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:57.618016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] PATH_INFO: `/v3/services/network` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:57.618828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:57.620553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:57.632818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:57.633875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:09:57.634717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:09:57.640872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 351/717] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:09:57 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:57.645985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:57.709619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:57.766798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed9d2b-efbf-4196-bbe2-05c02c357bef None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:57.812172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:57.812822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:57.813111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:57.813382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:57.814042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] RBAC: Adding query filter params (name=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:57.814350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:57.815779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3c447-f67c-41e0-84cd-c04aea9e8a54 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:57.821245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 367/718] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:09:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:57.827898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:57.933994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:57.992431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338681f6-8168-49ab-bfbc-163bfae73123 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:58.038434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:58.039045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:58.039325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:58.039592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:58.040227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] RBAC: Adding query filter params (type=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:58.040526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:58.041909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d529e3-59fb-4fed-b888-053bb3c6c98b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:58.053687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 352/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:09:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:58.425394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07178c-993b-404f-85c4-c6129b4b9beb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:58.425932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07178c-993b-404f-85c4-c6129b4b9beb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:58.426196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07178c-993b-404f-85c4-c6129b4b9beb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:58.427746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 368/720] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:58.434256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:58.434562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:58.434813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:58.458408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:58.459590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:58.551397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 353/721] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:09:58.916968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07178c-993b-404f-85c4-c6129b4b9beb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:59.038418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07178c-993b-404f-85c4-c6129b4b9beb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:59.063048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:59.085369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:59.085986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.086258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.086524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.101650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:09:59.107283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:59.108247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:59.110283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 369/722] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:59.114428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:59.160702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:59.214850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6239-5709-489e-8744-6b9e7408dd57 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:59.249093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:59.249691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.249964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.250224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.250874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:59.251166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:59.252519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:59.262143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 354/723] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:09:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:59.267923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:59.428215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef979ed-cd42-4e38-9e0b-450197c39eb3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:59.478088 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:59.478718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.478993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.479267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.497907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:59.499377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b5cc962c-b43c-429b-b64f-80261b959bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:09:59.517413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:09:59.518501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:09:59.519381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:09:59.519381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:09:59.519381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:09:59.520942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 370/724] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:09:59.525653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:59.546374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937e7a-7f1e-494f-a238-ad684089c7c2 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.546721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937e7a-7f1e-494f-a238-ad684089c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.546920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937e7a-7f1e-494f-a238-ad684089c7c2 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.548540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 371/725] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:09:59.553622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.554274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.554645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.583434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:09:59.584627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:09:59.637128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:59.720896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745a5a4-b490-4055-ac26-b9c83203f3fc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:59.727242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 372/726] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 28 12:09:59.736567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:59.762861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:59.763472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.763755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.764078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.764724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:09:59.765103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:09:59.766776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c23cfa-fa47-4401-92d9-a38741222f29 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:09:59.780048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 355/727] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:09:59.785095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:09:59.940183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f74ac-52ff-46d1-ac74-dffd65170f45 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:09:59.942935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5acbd6-69e8-42ab-aebc-de261499a944 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.943222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5acbd6-69e8-42ab-aebc-de261499a944 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.943490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5acbd6-69e8-42ab-aebc-de261499a944 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.949321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 356/728] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:09:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:09:59.954909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.955194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.955470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:09:59.987621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:09:59.988568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:09:59.989042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:09:59.989480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.001213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:00.002410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:00.005969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.007421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:00.028667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:00.029686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:00.030596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:00.031755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 373/729] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:09:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:00.039033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.081269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:00.112813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 357/730] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 12:10:00.112813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.189238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036367ec-eedf-4673-bead-cb87bc628f9d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.209559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:00.213864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3eff8-d26d-450b-b3d4-33078bb39652 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.238326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.239392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.240226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.240649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.241793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:00.242525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.244850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16824-2b8f-456c-8c53-66c3b2df5022 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.251861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaac88-c779-4713-9cbe-4f1ed7f59f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.252581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaac88-c779-4713-9cbe-4f1ed7f59f9b None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.253004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaac88-c779-4713-9cbe-4f1ed7f59f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.253371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaac88-c779-4713-9cbe-4f1ed7f59f9b None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.254206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaac88-c779-4713-9cbe-4f1ed7f59f9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.255903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaac88-c779-4713-9cbe-4f1ed7f59f9b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.269165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 374/731] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:00.270914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352215d3-a84a-4908-a33d-32acb165fafb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.271482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352215d3-a84a-4908-a33d-32acb165fafb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.271942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352215d3-a84a-4908-a33d-32acb165fafb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.273784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 375/732] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:00.274757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352215d3-a84a-4908-a33d-32acb165fafb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.276823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 358/733] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:00 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:00.279533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.280098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.280641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.301536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:00.303226 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:00.399305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 359/734] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:10:00.400664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.473104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:00.505390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:00.521436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352215d3-a84a-4908-a33d-32acb165fafb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.527666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d00bcb-71cc-4bda-960a-628b5f09579e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.573265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.574292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.574773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.575419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.576694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.577365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.577650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.577924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.591092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.592464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:00.593445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:00.598529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:00.599487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:00.600586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 360/735] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:00.605862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:00.615443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:00.616386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:00.618126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:00.618126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:00.618126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:00.618126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 376/736] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:00.625164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.714338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47f47-a3b8-482f-982b-ba1e4de50cc2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.739825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94196d4-b6a2-4574-9574-e5a5ebe8c575 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.750528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.751488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.751986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.752476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.753410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:00.753918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.755542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.764868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 361/737] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:00.766127 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.772727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:00.775616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:00.781865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.782483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.782759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.783031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.783755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:00.784063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.785693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.799569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 377/738] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:00.800416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.895432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7bfa-26a2-4e2e-827c-6e68af7a73bb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.912218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa19ca4-45dc-4a66-a679-8b141b4b860c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:00.936655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.937686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.938153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.938603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.948874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:00.949509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:00.949780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:00.950044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:00.952236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:00.958238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:00.959166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:00.960000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:00.960646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:00.962107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:00.963000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 362/739] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:00.964301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:00.978009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:00.979255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:00.980361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:00.980361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:00.980361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:00.981780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 378/740] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:00.982722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.030874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.040393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.079930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ae5e-4014-4a1f-8bed-7e8824d30fe0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.095963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869443db-7fad-491c-8900-a1c6a73776ea None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.115059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.115806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.116281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.116556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.123998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.125542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.131604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.132390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.132845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.133254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.134047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:01.134485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.136121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a4a78-f609-468f-a714-7f0051c0faa3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:01.136683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:01.137728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:01.138632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 363/741] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:01.139129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.151906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 379/742] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:01.153888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b0cc1-c02e-44f1-bd3f-6714669ee734 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.154167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b0cc1-c02e-44f1-bd3f-6714669ee734 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.154433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b0cc1-c02e-44f1-bd3f-6714669ee734 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.155807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 380/743] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:01.156300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b0cc1-c02e-44f1-bd3f-6714669ee734 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.248221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36976b-fd48-489a-a350-78a0c081e165 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.267802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b0cc1-c02e-44f1-bd3f-6714669ee734 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.275135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.275991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.286904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.287436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.287713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.287980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.288610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:01.288933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.290284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.302839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 364/744] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:01.303671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.308987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.308987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.308987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.308987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.309343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:01.309343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.310489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68a606-0848-46c7-a3b9-ca1e449ebad9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.327132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 381/745] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:01.327132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.327132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.327132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.343463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:01.344590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:01.415927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad720848-e11c-46b5-a1a6-60dc22de9240 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.425105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 382/746] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 12:10:01.426851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.455318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.456330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.456678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.457062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.470414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.472369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:01.488862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:01.490073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:01.491155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:01.491155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:01.491155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:01.497159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 365/747] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:01.498126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.541453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.559084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.569387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933aaa-61f2-4e66-96a2-ca7f5b862c55 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.609159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2955f4-14f9-4e54-b508-5a48d3b303aa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.616081 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.617441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.617899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.618342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.628795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.631014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.645978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.646741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.647085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.647419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/a5e487f1b5af4aa0a2d922d374adc29f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:01.647879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:01.648823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:01.649779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:01.650304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 383/748] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:01.650886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.653229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=a5e487f1b5af4aa0a2d922d374adc29f, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.654649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.670782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 366/749] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:10:01 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/a5e487f1b5af4aa0a2d922d374adc29f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:10:01.677789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.770444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff0795-8767-45ed-acf1-3621834ba23a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.809285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.811332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.812261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.812725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.813253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.814197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:01.814675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a9bc-5cda-472a-8b1d-3586f9a29aa4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:01.814922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.816538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.830311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 384/750] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:01.831773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.851901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:01.864357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:01.864959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:01.865242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:01.865510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:01.866251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:01.866551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:01.868269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:01.888618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 367/751] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:01.889619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:01.965696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b9d2f-52bc-4681-a693-4c6e6ea7fcaf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:02.006329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:02.007386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:02.008092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:02.008851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:02.011624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:02.013663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:02.030922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c5b8f-c153-4545-967e-1af04167d7aa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:02.045993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 385/752] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:01 2022] POST /identity/v3/services => generated 240 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:02.047599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:02.132630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:02.133353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:02.133690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:02.133902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:02.153607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:02.155549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:02.182088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:02.183319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:10:02.184360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:02.184927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 368/753] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:02.188405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:02.193894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:02.229353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99d2a1-8deb-435c-be15-f115c1f08df8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:02.247163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:02.286487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:02.287855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:02.288390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:02.289197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:02.409100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:02.413241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:02.417836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3029b-69a0-4f17-b424-34ca1c7a6a81 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:02.475244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:02.477089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:02.477205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:02.477445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:02.478212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:02.478505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:02.480565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:02.506940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 369/754] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 28 12:10:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:02.509114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:02.525176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:02.560563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 386/755] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:02.566715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:02.595792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:02.632629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862021-024a-4b59-b705-5cff0f8bc4cd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:02.671984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:02.672638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:02.673034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:02.673405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:02.730299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f448c-321a-44ba-915b-d8b569da862e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:02.757093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:02.759233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:02.839702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:02.840502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:02.840906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:02.841269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:02.841398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:02.869856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:02.872455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:02.880557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 370/756] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:02.886547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:02.915424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:02.916632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:02.917958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:02.917958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:02.917958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:02.920832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 387/757] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:02.924853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.010406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:03.054469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa950-1dcd-4143-bf1e-b46178ec183f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.094656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.095591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.096008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.096416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.110170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.113080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a6306551-3e76-4ae8-abbe-aabe8a00308a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:03.134024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:03.135221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:03.136964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:03.136964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:03.136964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:03.139368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 371/758] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:03.140811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ab9e-cd6d-41d6-a8f3-0a1e7e12ef7f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.141229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ab9e-cd6d-41d6-a8f3-0a1e7e12ef7f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.141674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ab9e-cd6d-41d6-a8f3-0a1e7e12ef7f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.143060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 372/759] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:03.148946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ab9e-cd6d-41d6-a8f3-0a1e7e12ef7f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.155714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738b0a9-f4f8-4b4b-a0f8-5f853a83ca6a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.184410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:03.192744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.193547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.193888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.194468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.194923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:03.195291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.196711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8b63-b20d-4078-b1e7-d532b019f2d5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.210559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 388/760] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:03.212077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.212435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.212752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.232515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:03.233838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:03.285281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ab9e-cd6d-41d6-a8f3-0a1e7e12ef7f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.312808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 389/761] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:03.312808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.343219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:03.348364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.349573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.349856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.350739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.351389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:03.352667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.354265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.379777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 373/762] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:03.387694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.495575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40616bd-6812-463b-abec-dd9e4096edc6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.537887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:03.559475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.560112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.560384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.560651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.569402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.570850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.573048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574837-4d48-48ef-9779-49c1c92797a4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:03.595442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:03.596369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:03.597289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 390/763] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:03.602733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.637113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.637800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.638080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.638349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.651782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.653571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:03.669744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:03.670634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:03.671504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:03.673837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 374/764] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:03.680646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.733233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:03.756209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d841fe-1eee-49d7-8616-fe0ead3accbe None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.814824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.815232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c1b5e-1c8c-4742-b593-aee4fa9fc47c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.815429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.815705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.815971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.816662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:03.817021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.819581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.835948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 391/765] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:03.837923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.861642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:03.862690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:03.863151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:03.863607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:03.864580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:03.865140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:03.866875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:03.881869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 375/766] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:03.883126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:03.886450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:03.973389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab607a-6bd0-4b81-a7be-26d905080b4c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:03.994402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7336d-2621-448b-8776-484d457d585d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.022223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.023882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.024321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.025056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.025870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.028341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.036471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.037267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.037644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.038015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.038853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=586cf4918eee4d13be7cc1adc56d8128) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:04.039308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:04.040540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:04.041752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:10:04.042778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:04.043780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.050241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 392/767] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:04.050241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:04.053606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:04.056545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 376/768] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:03 2022] GET /identity/v3/role_assignments?user.id=586cf4918eee4d13be7cc1adc56d8128&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:04.062604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:04.168863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:04.201093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3acb-8f95-4618-b6d2-32509ecfe24b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.223871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bcbf5-8cbb-432e-ae56-34b7f24c0746 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.249018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.250013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.250500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.250992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.252617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=8f582fce261d42b185ad05f699cf1f00) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:04.253193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.255365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad903f67-b75d-4004-8e0e-76f232476529 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.264593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 393/769] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:04 2022] GET /identity/v3/role_assignments?user.id=8f582fce261d42b185ad05f699cf1f00&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:04.266238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09315382-49c0-4b35-b0c0-d0443810437e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.266683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09315382-49c0-4b35-b0c0-d0443810437e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.266960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09315382-49c0-4b35-b0c0-d0443810437e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.268824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 394/770] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:04.274141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.274437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.274814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.275154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.275358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.275500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.275949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.276465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:04.277086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.278735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.284288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 377/771] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 28 12:10:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:04.290066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:04.300657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:04.303218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:04.406397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:04.428479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 395/772] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:04.435496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608472e-7823-4e3b-9139-fa02d076a090 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.468546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:04.474766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.475685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.476319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.476581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.477235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:04.477530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.478871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.484619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 378/773] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 28 12:10:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:04.490082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:04.598977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c300b0-6947-4bee-936d-04d85c6cbb97 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.636202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.640805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.640805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.640805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.640805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] RBAC: Adding query filter params (interface=public, service_id=573fe73280094226820db5417f61ac2b, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:04.640805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.640805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.647555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 396/774] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:04 2022] GET /identity/v3/endpoints?service_id=573fe73280094226820db5417f61ac2b&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:04.653113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:04.764866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:04.817498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f827e9-8602-41e8-9291-ccac11a2bf35 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.846590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:04.864656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d824c1-4d69-4651-968c-fd5e9b2da7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.865217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d824c1-4d69-4651-968c-fd5e9b2da7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.865493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d824c1-4d69-4651-968c-fd5e9b2da7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.865760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d824c1-4d69-4651-968c-fd5e9b2da7d7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.866357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d824c1-4d69-4651-968c-fd5e9b2da7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:04.868289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d824c1-4d69-4651-968c-fd5e9b2da7d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:04.880878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 379/775] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:04 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:04.882414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4938-ef26-4552-a9e0-b5da26de406b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.882765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4938-ef26-4552-a9e0-b5da26de406b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.883099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4938-ef26-4552-a9e0-b5da26de406b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.890201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 380/776] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:04.897252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.897574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.897793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:04.925995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fc79c-0e95-427c-b7bd-0c47cf7ba7a1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:04.937609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:04.938826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:04.992255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:04.992917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:04.993191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:04.993453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:05.025701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:05.032182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:05.033233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:05.034052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:05.041285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 397/777] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:05.041952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:05.048192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.078542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 381/778] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:05.191689 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f2ef1-1180-42d6-92ee-069043e37d5d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:05.214320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:05.235399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:05.236010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:05.236282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:05.236545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:05.237248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:05.237545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:05.238919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:05.249546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 398/779] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:05.255911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.388160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353317-5123-46c6-b9fb-8636c2b9e89d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:05.400700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.437382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:05.439633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:05.439912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:05.440182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:05.456732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:05.458145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:05.493988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:05.496721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:05.497651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:05.497651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:05.497651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:05.497651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 382/780] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:05.505693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.539880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2866d6-98be-49b6-993c-a54d5b6d2bc7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:05.565813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:05.590072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:05.590711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:05.590985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:05.591251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] PATH_INFO: `/v3/services/network` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:05.591839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:05.593230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:05.616970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:05.618383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:10:05.619221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:05.620049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 399/781] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:05.626572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.639648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c178ab5-857f-4404-90e2-8d5911f183b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:05.683294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:05.683907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:05.684159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:05.684317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:05.684988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:05.685306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:05.686640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:05.708825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 383/782] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:05.717224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:05.717894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.817729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec7ea-fcff-4dc0-b3ed-35ea299e8b28 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:05.876933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:05.877545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:05.877829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:05.878101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:05.879065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] RBAC: Adding query filter params (name=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:05.879379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:05.880863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:05.892256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 400/783] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:05.897288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:05.925130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6615753-4029-4228-a3e4-f6cee286aabb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:05.929092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:06.029582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:06.030147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.030426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.030703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.047607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c17ce-868a-45c2-b917-de1ea1805b3b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:06.049666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:06.051097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:06.073638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:06.074213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:06.076215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:06.077178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:06.085977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 384/784] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:06.087463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:06.108162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:06.108889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.109172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.109436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.110069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] RBAC: Adding query filter params (type=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:06.110366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:06.112166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:06.118272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 401/785] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:06.129572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:06.289350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4bb6e-ead4-45f9-bc91-cc00ca7c2d94 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:06.291126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3141-d34a-43a6-90ce-a5f61b086af5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:06.324937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:06.325603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.325884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.326153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.326860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] RBAC: Adding query filter params (interface=public, service_id=0c57dd68bf69401c82accab957ab0049, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:06.327166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:06.328754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:06.334751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 402/786] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:06 2022] GET /identity/v3/endpoints?service_id=0c57dd68bf69401c82accab957ab0049&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:06.340399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:06.376523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:06.377227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.377485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.380834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.380834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:06.380834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:06.380834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:06.400807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 385/787] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:10:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:06.406807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:06.421145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:06.443974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:06.535699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee2bf0-a5d7-4e32-9812-3cb88626df38 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:06.602510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d61d-1b37-46bb-ae1b-b8011823c168 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:06.604988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c649c-0c59-4ce4-9e20-6b9d9ae7cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:06.605620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c649c-0c59-4ce4-9e20-6b9d9ae7cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.605928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c649c-0c59-4ce4-9e20-6b9d9ae7cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.606189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c649c-0c59-4ce4-9e20-6b9d9ae7cfa2 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.606773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c649c-0c59-4ce4-9e20-6b9d9ae7cfa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:06.608203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c649c-0c59-4ce4-9e20-6b9d9ae7cfa2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:06.620844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 403/788] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:06 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:06.664665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:06.665312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.665590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.665865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.747107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:06.748575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:06.778809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:06.831338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2756-a7ec-4d28-86f6-5b76b6b78612 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.831611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2756-a7ec-4d28-86f6-5b76b6b78612 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.831877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2756-a7ec-4d28-86f6-5b76b6b78612 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.836171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 404/789] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:06.839724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07ebb1-acf5-47ef-a1b8-773a848b0568 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:06.840004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07ebb1-acf5-47ef-a1b8-773a848b0568 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:06.840274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07ebb1-acf5-47ef-a1b8-773a848b0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:06.863699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0e07ebb1-acf5-47ef-a1b8-773a848b0568 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:06.867730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e07ebb1-acf5-47ef-a1b8-773a848b0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:06.886496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 386/790] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:06.891365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.074487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 405/791] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:07.075919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b833-9bf3-4bfc-ab79-df7f2737c5a0 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.076227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b833-9bf3-4bfc-ab79-df7f2737c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.076497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b833-9bf3-4bfc-ab79-df7f2737c5a0 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.076942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b3bf-6352-4ccd-8569-83a593dac564 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.082580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 406/792] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:07.084554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.084554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.084554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.129504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:07.131014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:07.207991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:07.235345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:07.267622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.268247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.268519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.268799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.286329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 407/793] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:07.287129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:07.288611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:07.303990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:07.305004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:07.305907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:07.305907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:07.305907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:07.305907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 387/794] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:07.313421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.404073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.466708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d55b25-6021-49fd-a08a-17f10f101e31 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.503362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.504075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.504347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.504610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.505280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:07.505576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:07.507157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a247020-711a-48ec-9c4e-b355d75a7f80 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:07.520018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 408/795] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:07.521466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbbab-d6cc-4ea7-bd3c-2d94203f8cde None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.521750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbbab-d6cc-4ea7-bd3c-2d94203f8cde None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.522110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecbbab-d6cc-4ea7-bd3c-2d94203f8cde None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.523587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 409/796] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:07.525122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5855a-11af-44b4-9778-2f42f41dddbb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.530436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.530768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.531094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.551264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:07.552673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:07.561011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.561655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.561999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.562331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.572787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:07.577129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:07.578523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:07.579690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:10:07.581032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:07.582367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 388/797] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:07.583355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.615928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:07.631571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 410/798] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:07.633062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.723145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682d34-2b9a-406d-9807-48d1d3f21f55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.750385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d62fe-a844-45f7-8a62-36266b42cee0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.769043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.769681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.769958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.770689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.779930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:07.782060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:07.793664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.794555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.795000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.795464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.796276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:07.796787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:07.798492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:07.806276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:07.807123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:07.808729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 389/799] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:07.809297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 411/800] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:07.821817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.844850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:07.925910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:07.937647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ffdb-6930-4784-98b9-5ae82449a5ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.958996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffb7e7-3111-4b36-a6a9-a0770e62272c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:07.972944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.973614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.973831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.974102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:07.986309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:07.991379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:07.992374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 390/801] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:07.993251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:07.998053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:07.998890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:07.999169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:07.999443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.000140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.000444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.002024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.015138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 412/802] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.015925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.098590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.103200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729093cf-4111-44fb-850d-46507eb61456 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.125890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c8571-2d75-4528-9ad3-4be930fcf917 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.135129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.136276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.136570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.136924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.147001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.148412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.162709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.163336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.163612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:08.163849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:08.164720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:08.165643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:08.165643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:08.165643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:08.165808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.165808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.165808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.168029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 391/803] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:08.169130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.171723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:08.181291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:08.183170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:08.184014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 413/804] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:08.184827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.281309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bd7e-bc04-4db1-80a4-b91fe6ae77ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.288340 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c50d47-4718-4ba7-ba19-3f4fe714e71a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.321043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.321643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.321920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.322180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.322834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.323128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.323684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.324283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.324477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.324573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.324844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.325569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=a5e487f1b5af4aa0a2d922d374adc29f) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.325881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.327285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.341059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 414/805] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/role_assignments?user.id=a5e487f1b5af4aa0a2d922d374adc29f&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.341059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.341350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 392/806] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.341350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.343544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.433791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.458403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3118b17-a1ef-451b-bce8-f2675593310d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.495507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9abd3-f223-4ce7-be70-962f186e3bcd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.500371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.501157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.501536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.501912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.502738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.503146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.504766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.520424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 415/807] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.521350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.541727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.542910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.543191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.543458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.544085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.544385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.545770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.551451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 393/808] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.552341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.600592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.646047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d87fd-2077-4776-99a0-4e7b401507b9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.680296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb11f0-4002-4678-994f-2d0098083786 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.692471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.693804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.694305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.695162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.709533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.712157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.715283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.725942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.727195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.727548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.727887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:08.735300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:08.736242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:08.737242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:08.737242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:08.737242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:08.738008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 416/809] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:08.738807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.740504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.742274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:08.758025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:08.759034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 394/810] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:08.761307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.873760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706b79-fc36-4b94-8630-2b9f2026edc6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.883113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425187aa-a16d-4bd8-87d4-3a84f3bd329e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:08.888879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:08.913003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.914046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.914609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.915119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.916495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.917727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.919852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.923945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:08.924846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:08.925330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:08.925822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:08.926370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 417/811] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.927046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:08.927246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.927740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:08.929347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:08.944405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 395/812] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:08.947162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:08.999565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.044907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e772c52-7efc-4cf6-bacd-8fd2e2058802 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.059626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a72917-7cd1-45bd-868e-d9750a2f20a4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.081002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.081556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.081840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.082111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.082932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:09.083196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.084728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.097581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.098486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.099010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.099482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.100343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.101950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.104012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 418/813] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 28 12:10:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:09.105119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.128906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 396/814] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:09.130256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.144445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.231675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225176d-b516-4594-8d42-2f897f9d79fe None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.259607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.265912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce6a7b-eb37-449f-81cb-ef05e0174f40 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.287179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.287855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.288137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.288411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.298213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.299874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.312991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.313947 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.314428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.314919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-02096b1d-9412-4b4c-aae7-10bdecafaccc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:09.315217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:09.316142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:09.317526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 419/815] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:09.318454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891490e1-6a67-419d-95af-112a3f10c537 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.318454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891490e1-6a67-419d-95af-112a3f10c537 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.318454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891490e1-6a67-419d-95af-112a3f10c537 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.319836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 420/816] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:09.325714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891490e1-6a67-419d-95af-112a3f10c537 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.335728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.337395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-50ab9a12-ad21-4993-81f3-b1352bb9eb44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:09.356664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:09.357912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:09.358949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:09.358949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:09.358949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:09.358949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 397/817] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:09.359573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.360022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.360296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.381832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:09.383101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:09.465799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.467890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 398/818] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:09.472911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.483408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891490e1-6a67-419d-95af-112a3f10c537 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.532201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.533475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.533960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.534230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.534962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:09.535266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.536704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.573979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 421/819] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:09.577628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.628873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.663389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08800-1365-415e-a2bc-1d9ba5c6f3ad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.730644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.731259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.731544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.731812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.732461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:09.732766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.734143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.739137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729844d-7093-4dde-8a94-5e398458cabf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.757077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 399/820] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:09.763094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.780711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.781718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.782204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.782654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.804661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.806820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:09.827472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:09.828459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:09.829572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:09.829572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:09.829572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:09.829572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 422/821] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:09.829572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.839198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.924911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf7f5-2743-48da-9021-6ebb7c19e3d3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.932793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14bba-2b34-4e3c-932f-409e2d702913 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:09.969375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.969997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.970269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.970537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.973824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:09.974656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:09.975113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:09.975588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] PATH_INFO: `/v3/services/network` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:09.976351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.977576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:09.978454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.978993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:09.989275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:09.990261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 12:10:09.991145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:09.991879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:09.993003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 400/822] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:09.994160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:09.996402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:09.998379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 423/823] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:10.001867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.099779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:10.108254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe9bf9-7f19-4ebd-817c-b3b541c43a41 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.144602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30478dc-156c-4670-b3d2-a8fbac8e6419 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.153049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.153655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.153993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.154263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.154904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:10.155199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.156535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.176434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 401/824] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:10.177352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.190509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.191706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.192234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.192863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.194160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:10.194911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.197069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.213246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 424/825] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:10.215041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.249021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:10.291206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0ec1-0ad0-49e5-8671-381ca3ebc45a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.329002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.329930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.330408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.331133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.332177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:10.332645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.334194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.343486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76b367-7b7f-4d02-a1c0-b9d5e8b2e5dc None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.344274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 402/826] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:10.345360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.377474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:10.386336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.386997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.387274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.387544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.396088 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.398089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:10.413214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:10.414159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:10.415018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:10.422903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 425/827] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:10.423990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.464907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c003e8-1849-4582-a6f6-dcf3d2f920f4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.500742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:10.511436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.512477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.512759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.513060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/586cf4918eee4d13be7cc1adc56d8128/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.534817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=586cf4918eee4d13be7cc1adc56d8128, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.536235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.540477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f348b9b-6016-47ab-917e-21e1ea448026 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.550988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 403/828] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:10:10 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/586cf4918eee4d13be7cc1adc56d8128/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:10:10.552136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.581598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.582605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.583055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.583529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.584458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] RBAC: Adding query filter params (type=network) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:10.584990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.586773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.594047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 426/829] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:10.601951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.670653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d838-6934-4559-93f8-5d0a045c6b52 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.709944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.710740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.711108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.711471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.712268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:10.712668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.715198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.728407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 404/830] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:10.734970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:10.762203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:10.805193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:10.838157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb70fc-4a57-43b3-bdf0-e12f9a801a6a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.885784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebfb42-d8a1-496a-8353-2c48a400923e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:10.894202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bee76-81ee-42fb-9fed-ce17e7346432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.895112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bee76-81ee-42fb-9fed-ce17e7346432 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.895995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bee76-81ee-42fb-9fed-ce17e7346432 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.896448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bee76-81ee-42fb-9fed-ce17e7346432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.897727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bee76-81ee-42fb-9fed-ce17e7346432 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.899889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bee76-81ee-42fb-9fed-ce17e7346432 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.924378 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:10.925345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.925899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.925899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/8f582fce261d42b185ad05f699cf1f00/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.927856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=8f582fce261d42b185ad05f699cf1f00, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:10.929570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:10.932323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 427/831] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:10.935072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf99a-c47b-4b0b-b855-fca61b03f9c4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.935565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf99a-c47b-4b0b-b855-fca61b03f9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.935912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf99a-c47b-4b0b-b855-fca61b03f9c4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.942954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 428/832] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:10.944825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94120-4eea-48b4-9c98-2456552eb7bb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:10.944825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94120-4eea-48b4-9c98-2456552eb7bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:10.945009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94120-4eea-48b4-9c98-2456552eb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:10.957440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 405/833] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:10:10 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/8f582fce261d42b185ad05f699cf1f00/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:10:10.974300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0bc94120-4eea-48b4-9c98-2456552eb7bb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:10.975520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0bc94120-4eea-48b4-9c98-2456552eb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:11.064608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 429/834] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:11.409442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:11.515027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:11.515214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df62c5b-a627-40ca-a1d4-b1207723b559 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:11.515501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df62c5b-a627-40ca-a1d4-b1207723b559 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:11.515692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df62c5b-a627-40ca-a1d4-b1207723b559 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:11.517194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 430/835] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:11.522720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:11.523326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:11.523823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:11.524996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd81c21-b8bb-4c19-a4e6-681ddc6411d7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:11.544516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:11.546046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:11.568381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:11.569322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:11.569612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:11.569881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:11.570463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:11.572515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:11.578259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:11.587657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:11.589197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:11.590454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:11.594421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 406/836] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 28 12:10:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:11.595624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:11.634217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 431/837] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:11.705796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6445a85-5018-4b79-8568-ab1378fffefe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:11.740249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:11.741269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:11.741754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:11.742241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:11.743061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:11.743562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:11.745934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:11.754535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 407/838] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:11.757138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:11.874485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed399db-58ad-43b2-8177-173b620c8799 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:11.905281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:11.912208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:11.913121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:11.914019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:11.914500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:11.915350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:11.916288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:11.918764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:11.925519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 432/839] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:11.945456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:12.032350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953686ee-8e2e-46bd-a4a8-423aa6d4d224 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:12.069822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:12.070835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:12.071319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:12.071791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:12.072612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:12.074832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:12.084976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:12.086045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:12.086868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:12.090388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 408/840] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:12.095958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:12.134862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:12.214855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f2ba-0094-4eee-9981-f7187715d02e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:12.250273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:12.250927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:12.251199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:12.251460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:12.252077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:12.252368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:12.253744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9beeb-02e2-4aee-8482-e34d9bfda60e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:12.258633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 433/841] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:12.266112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:12.358928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:12.373674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89e16-2984-40ca-a121-6ba657a9de5f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:12.408612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:12.409466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:12.409749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:12.410015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:12.410644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:12.410940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:12.412354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f0283-8641-4218-964f-3385ec3480eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:12.417464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 409/842] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:12.966272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5b42-36ea-4274-a1ca-a28a4dbebce3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:12.966782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5b42-36ea-4274-a1ca-a28a4dbebce3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:12.966782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5b42-36ea-4274-a1ca-a28a4dbebce3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:12.968365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 434/843] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:12.973855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c71b38-c154-418f-9323-2d6e4aa097c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:12.974290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c71b38-c154-418f-9323-2d6e4aa097c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:12.974466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c71b38-c154-418f-9323-2d6e4aa097c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:12.993186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d4c71b38-c154-418f-9323-2d6e4aa097c2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:12.994381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d4c71b38-c154-418f-9323-2d6e4aa097c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:13.064639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 410/844] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:13.344108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b5b42-36ea-4274-a1ca-a28a4dbebce3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:13.377796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e72c-9753-45ec-aa43-8f8cc7abbf2d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:13.378410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e72c-9753-45ec-aa43-8f8cc7abbf2d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:13.378911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e72c-9753-45ec-aa43-8f8cc7abbf2d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:13.380862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 411/845] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:13.386728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:13.387343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:13.387839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:13.407412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:13.409024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:13.442282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:13.450284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b5b42-36ea-4274-a1ca-a28a4dbebce3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:13.483625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 412/846] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:13.496511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:13.497428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:13.497937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:13.498400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:13.509139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:13.514294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:13.515186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:10:13.516037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:13.518583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 435/847] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:10:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:13.524293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:13.538864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:13.630183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e38da-bdb3-4f0b-8b8a-301865e94a9c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:13.665130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:13.665738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:13.666016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:13.666287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:13.667006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:13.667306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:13.668663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:13.677369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 413/848] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:10:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:13.683482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:13.785366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:13.786675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880d900-0fda-466e-9797-1372519a83ab None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:13.829189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:13.830224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:13.830961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:13.831447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:13.844015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:13.845797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:13.862078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:13.863016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:13.863886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:13.863886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:13.863886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:13.865976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 436/849] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:13.871550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:13.884962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:13.892309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:13.919112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4162d7-7a76-4f67-a543-f38b3e40a945 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:13.958853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:13.959508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:13.959778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:13.960036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:13.972879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:13.978199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:13.980350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:13.981232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 414/850] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:13.986199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:13.998578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593a86-e5b3-4b87-b9ea-b50505b5296e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.037918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.038938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.039420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.039929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.040797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:14.041992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.043751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.062091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 437/851] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:14.063692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.126054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e03e2-75a5-429f-b91e-fbec7086d5b8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.139759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.163981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.164571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.164877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.165151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.165818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:14.166122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.168334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.169782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.183571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 415/852] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:14.185522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.187313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf0568-f33c-4921-9123-24df7b2e77c4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.226028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.227041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.227571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.228020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.237146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.238993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-582a6e77-6543-46ea-b243-ffa49522d18b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:14.254142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:14.255143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:14.256113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:14.258426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 438/853] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:14.259829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8ed70-dc78-47b0-9d9f-28186f025f50 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.260353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8ed70-dc78-47b0-9d9f-28186f025f50 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.260804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8ed70-dc78-47b0-9d9f-28186f025f50 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.262198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 439/854] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:14.265750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8ed70-dc78-47b0-9d9f-28186f025f50 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.295031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782aaf-3814-495c-a288-4dc01b764a42 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.331579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.332202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.332499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.332741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.344565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.346057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b11cef2c-584f-42b0-8fe1-4c4cd3f04503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:14.362758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:14.363728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:14.364599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:14.364599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:14.364599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:14.364599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 416/855] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:14.365276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.365276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.365641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.380165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8ed70-dc78-47b0-9d9f-28186f025f50 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.383707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:14.384897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:14.407668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.416989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.417598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.417876 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.418148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.418877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:14.419184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.420598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.435764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.438688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 440/856] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:14.439751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.468259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 417/857] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:14.469475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.580257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e83a45-8641-4959-bb76-2795ec9804cf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.591073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb1c9c-24bd-4908-b3c3-e21fd9fc11fb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.616383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cb665-1a58-4bba-a031-3e67c281f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.617027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb665-1a58-4bba-a031-3e67c281f652 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.617308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb665-1a58-4bba-a031-3e67c281f652 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.617573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cb665-1a58-4bba-a031-3e67c281f652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.636213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.636840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.637121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.637524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.638023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:14.638324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.639683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de02f-49c5-4b5b-898a-508cc6cd9a49 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.656494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 441/858] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:14.656494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a7f9b-f85c-4096-98d6-e0978247ab8e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.656494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a7f9b-f85c-4096-98d6-e0978247ab8e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.656494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a7f9b-f85c-4096-98d6-e0978247ab8e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.656494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 442/859] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:14.660138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a7f9b-f85c-4096-98d6-e0978247ab8e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.670816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.696425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cb665-1a58-4bba-a031-3e67c281f652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.698032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cb665-1a58-4bba-a031-3e67c281f652 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.709009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.769647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a7f9b-f85c-4096-98d6-e0978247ab8e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.796818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 418/860] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:14.798359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.798640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.798913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.808953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.809583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.809860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.810125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] PATH_INFO: `/v3/users/swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.817162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:14.817699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.818355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:14.819118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:14.831075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:14.832026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 443/861] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:14.837662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.886572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 419/862] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:14.887237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:14.896929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.947042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d19f8-a26b-46ce-86b9-722a9eba45de None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:14.950456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:14.983329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:14.983836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:14.984135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:14.984375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:14.985046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:14.986603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:14.999152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66f51-fb82-4dcb-b5b1-1e6aadc7e6b6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.004888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 444/863] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:14 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:15.004888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.043775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.044518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.044905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.045279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.056399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.058140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:15.075072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:15.076382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:15.077577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:15.077577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:15.077577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:15.078432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 420/864] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:15.088956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.154330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f499d2-5c40-4f78-a6fd-be840535db40 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.162717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.206071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.206600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.206883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.207153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.207889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:15.208197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.209675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.213749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e8696-34e2-4fa2-9f9e-101eae3fc401 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.228224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 445/865] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:15.229869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.252650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.253254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.253544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.253801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.254435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:15.254732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.256080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.260021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.270244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 421/866] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:15.270914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.348029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c75d41-840e-4b50-b4d0-379a336991a6 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.379010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934ef2-2c3e-4d53-adac-2d70b47fed3d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.384007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.384608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.384910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.385319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.385988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.387361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.397426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.403735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 446/867] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:15 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:15.404512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.436120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.436991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.437340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.437686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.515449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.523535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.526487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.542035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360287d7-86fb-4641-b221-9f4e4e01b947 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.591202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.592035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.592923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.593406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.607303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.609249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:15.621660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:15.622580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:15.623442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:15.625163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 447/868] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:15.631275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.663469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 422/869] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:15.669789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.686583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.759557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080697ea-b146-4bb1-ac40-a181a2cf934e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.801415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.801955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.802234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.802395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0d87d-4790-4618-8247-39a3559269f2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.802492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.803309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:15.803612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.805084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.821187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 448/870] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:15.828342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.837090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.850741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.851373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.851653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.851930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.862739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.864174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:15.883268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:15.884280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:15.885773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:15.885773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:15.885773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:15.885773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 423/871] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:15.891132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:15.941480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b99c-4ec3-438f-bad7-538a8d1bdf4f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:15.962409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:15.980914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:15.981671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:15.982043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:15.982407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:15.983238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=586cf4918eee4d13be7cc1adc56d8128) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:15.983648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:15.985557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:15.992094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 449/872] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/role_assignments?user.id=586cf4918eee4d13be7cc1adc56d8128&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:16.015284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12736c-1bdb-46e7-9cd1-7607f269a76e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:16.052174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:16.052700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:16.053003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:16.053274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:16.053920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:16.054220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:16.055579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:16.069743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 424/873] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:16.077988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:16.152254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:16.192080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992fb1-8252-4053-9615-ac088cea2d9a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:16.227220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:16.227808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:16.228084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:16.228351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:16.235960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:16.237442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:16.249447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:16.250357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:16.251286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 450/874] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:16.258629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:16.366213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb0a0-db66-4d5b-8e3b-9a76179a4c27 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:16.393861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:16.405207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:16.405828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:16.406108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:16.406379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:16.407079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:16.407386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:16.408853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f27cb-1890-48c5-b8bc-e65054f01787 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:16.423361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 425/875] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:16.429370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:16.536385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a21fc-7bb5-4da3-9a27-4d97a0f81481 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:16.563842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:16.573845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:16.574693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:16.575187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:16.575660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:16.576583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=8f582fce261d42b185ad05f699cf1f00) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:16.577102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:16.578704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc7133-e131-411e-95dc-c3d500d1cc55 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:16.585152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 451/876] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:16 2022] GET /identity/v3/role_assignments?user.id=8f582fce261d42b185ad05f699cf1f00&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:17.253422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5cd3-276a-4f22-9796-4b3c64498faa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:17.253965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5cd3-276a-4f22-9796-4b3c64498faa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:17.253965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5cd3-276a-4f22-9796-4b3c64498faa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:17.255600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 426/877] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:17.261582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e1bb3-a683-4d8c-9aa3-453f374be438 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:17.262026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e1bb3-a683-4d8c-9aa3-453f374be438 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:17.262101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e1bb3-a683-4d8c-9aa3-453f374be438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:17.280361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-917e1bb3-a683-4d8c-9aa3-453f374be438 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:17.281581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-917e1bb3-a683-4d8c-9aa3-453f374be438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:17.353484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 452/878] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:17.618459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc5cd3-276a-4f22-9796-4b3c64498faa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:17.726418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc5cd3-276a-4f22-9796-4b3c64498faa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:17.762479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:17.763137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:17.763414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3af11-8d3f-45dd-bdba-8443d31253df None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:17.763528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:17.763681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:17.763774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3af11-8d3f-45dd-bdba-8443d31253df None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:17.763957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3af11-8d3f-45dd-bdba-8443d31253df None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:17.764262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:17.765592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 453/879] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:17.765723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:17.770815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:17.771317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:17.771806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:17.774831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:17.775780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:17.777152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 427/880] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 28 12:10:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:17.784001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:17.800052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:17.806738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:17.840132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:17.885611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 454/881] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:17.897607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac443-1314-4fd5-977e-1a0b09c0c63f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:17.933586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:17.934204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:17.934480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:17.934748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:17.935381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:17.935680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:17.937050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:17.946581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 428/882] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:17.948140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.002247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.053554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae58759-369d-421b-89db-cbf2ee85a469 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.088966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.090024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.090351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.090620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.091246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:18.091542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.092934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.102633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 455/883] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:18.104151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.161736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.217608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64785075-917b-41bc-b00a-dd2e520247de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.233325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.257445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.258174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.258646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.258979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.259753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] RBAC: Adding query filter params (interface=public, service_id=a720cc6b298a48e4968bf5a431a20114, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:18.260760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.262238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.270734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 429/884] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/endpoints?service_id=a720cc6b298a48e4968bf5a431a20114&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:18.276610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.284711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560822c-247a-4596-9207-e5b32c26356a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.304651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.330398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.331604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.331889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.332154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.332742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.334137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1f1c1ddd-ae7a-4f89-8ff2-04acfcb03be3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:18.343453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:18.344519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:18.345471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 456/885] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:18.346322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a8578-a578-4a74-9d9b-a45d817a8f96 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.346322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a8578-a578-4a74-9d9b-a45d817a8f96 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.346322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a8578-a578-4a74-9d9b-a45d817a8f96 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.347418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 457/886] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:18.350158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a8578-a578-4a74-9d9b-a45d817a8f96 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.405214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdac824-8b63-4e15-accb-8aa3597d5141 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.440494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a75c5d-b87e-4ae5-a84a-32f2cd94eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.441073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75c5d-b87e-4ae5-a84a-32f2cd94eabd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.441357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75c5d-b87e-4ae5-a84a-32f2cd94eabd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.441620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a75c5d-b87e-4ae5-a84a-32f2cd94eabd None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.442218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75c5d-b87e-4ae5-a84a-32f2cd94eabd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.443575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a75c5d-b87e-4ae5-a84a-32f2cd94eabd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.450377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 430/887] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:10:18.451603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.451887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.452153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.472622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:18.473950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:18.482480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a8578-a578-4a74-9d9b-a45d817a8f96 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.515702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.537800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.539534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.540180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.540734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.542774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:18.543868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.546090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.559675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 458/888] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:18.560973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.565815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 431/889] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:18.611592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.675565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0b016-a8f3-4212-b411-9d04f8132739 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.711172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.711692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.711960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.712221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.712923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:18.713259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.714656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.719990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 459/890] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:18.725760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.836271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.852409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f454421-f926-462e-a432-93ef73d36fbe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.902183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.903787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.904269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.904720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.905664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] RBAC: Adding query filter params (interface=public, service_id=145e23375214423a9db2af7873b68e8e, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:18.906415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:18.908523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:18.915823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 432/891] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/endpoints?service_id=145e23375214423a9db2af7873b68e8e&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:18.922140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:18.948112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e2a72-d3bc-40a7-b247-f6ff57e1eaae None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:18.955852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.961005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:18.984870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae77b7-7a45-4014-b7ed-fa57257e1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:18.985422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae77b7-7a45-4014-b7ed-fa57257e1483 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:18.985693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae77b7-7a45-4014-b7ed-fa57257e1483 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:18.985961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae77b7-7a45-4014-b7ed-fa57257e1483 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:18.998262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae77b7-7a45-4014-b7ed-fa57257e1483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c2ae77b7-7a45-4014-b7ed-fa57257e1483 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:19.003373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:19.004360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:19.005248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 460/892] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:19.007275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80602-cb59-40d3-92dc-a6d0454076bb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.007275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80602-cb59-40d3-92dc-a6d0454076bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.007275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80602-cb59-40d3-92dc-a6d0454076bb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.008487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 461/893] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:19.013803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80602-cb59-40d3-92dc-a6d0454076bb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.042454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5836f-d027-4e7e-a090-52ff48085009 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.080358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1c43-88bd-4bb3-a387-4c25ab8c74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.081260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1c43-88bd-4bb3-a387-4c25ab8c74cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.081549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1c43-88bd-4bb3-a387-4c25ab8c74cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.081806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1c43-88bd-4bb3-a387-4c25ab8c74cd None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.082413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1c43-88bd-4bb3-a387-4c25ab8c74cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.083768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1c43-88bd-4bb3-a387-4c25ab8c74cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.089508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 433/894] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:18 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:10:19.089508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.089508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.089508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.110734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:19.111974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:19.147298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80602-cb59-40d3-92dc-a6d0454076bb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.192594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 434/895] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:19.195550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.196388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.196895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.197343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.198809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:19.199276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.200985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.211909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 462/896] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:19.220821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.254620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:19.329832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a57c2-d477-4ab4-bcba-36947b1dc898 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.365409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.366365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.366833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.367285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.377812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.379476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:19.396001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:19.397104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:19.397999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:19.397999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:19.397999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:19.400041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 435/897] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:19.406158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.437543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:19.473443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.516427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc088-af60-43cb-a84c-7d1382b70b72 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.565717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.566395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.566678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.566942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.567589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:19.567885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.569282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.578770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:19.588892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 463/898] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:19.593419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.606210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbe7c7-60aa-4b32-9352-c56c12b565db None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.654956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.656046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.657141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.657644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.658661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.661219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:19.674082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:19.675096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:19.676016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:19.681114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 436/899] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:19.684758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.698855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:19.711534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b1b40-515e-459d-84d9-190dbe287bc8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.747190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.748188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.748643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.749105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.757331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.758994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:19.770991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:19.771948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:19.772897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:19.775006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 464/900] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:19.782512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.799425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8f88b-b724-4661-863b-545f87cd11e1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.845420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.846459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.846897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.847595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.848371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:19.850516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.852346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.860465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 437/901] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:19.869781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.889191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:19.905125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5fc0-5726-4e2a-86bb-3656be3f784d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:19.952355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:19.952990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:19.953265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:19.953559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:19.954793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:19.955096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:19.957288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:19.984936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 465/902] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:19.990076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:19.991143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408df48-d952-4858-85d7-9c7b1f171b8c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:20.000074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:20.031001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:20.032076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.032594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.033094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.034014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:20.034621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:20.036280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:20.049179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 438/903] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:20.110661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662bffa-049e-470e-8c1f-94cf7f2999a4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:20.149524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:20.150131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.150403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.151234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.225311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:20.227150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:20.235685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:20.333772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 466/904] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:19 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:20.340499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:20.414351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:20.446750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fbc7b-29f7-4cde-89d3-a62fa9765e32 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:20.484014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:20.484930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.485368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.485779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.496219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:20.497968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:20.513308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:20.514469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:20.515564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:20.515564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:20.515564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:20.517234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 439/905] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:20.523017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:20.631945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca042d-78bb-43b9-b195-99c9c6e20d3a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:20.644597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:20.668703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:20.669327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.669600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.669861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.670494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:20.670788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:20.672233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a4d6-b36a-4f45-91c6-14681713526b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:20.689055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 467/906] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:20.690488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:20.717341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d6cd1-ccb8-4059-ab75-773fec6afd94 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.717657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d6cd1-ccb8-4059-ab75-773fec6afd94 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.717886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d6cd1-ccb8-4059-ab75-773fec6afd94 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.719438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 468/907] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:20.724209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.724492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.724763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.743705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:20.745588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:20.820735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3e7d-c450-4534-af32-7c33651f4762 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:20.833140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 469/908] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:20.849165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:20.858175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:20.858806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:20.859077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:20.859342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:20.866102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:20.867516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:20.878826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:20.879745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:20.880607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 440/909] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:20.886533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:20.989235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:20.994417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151d3c6-0dbf-4b5a-a6be-2a08633b18f4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.033830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.034434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.034704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.034964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.035657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:21.035950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.037401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.049970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 470/910] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:21.055953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.130111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.168477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac81853-682d-4ee0-96b4-5f65c14ce4de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.214957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.215700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.216070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.216427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.217442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] RBAC: Adding query filter params (role.id=969d2ab6c29940dfb70871d5a27baf8d, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=586cf4918eee4d13be7cc1adc56d8128) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:21.219124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.220619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.236822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 441/911] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:21 2022] GET /identity/v3/role_assignments?user.id=586cf4918eee4d13be7cc1adc56d8128&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=969d2ab6c29940dfb70871d5a27baf8d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:21.253742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab18a-e2d7-4d9a-bbdb-efff82f506aa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.294573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.295358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.295723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.296086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.296791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.299618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-bc0ae6f4-e4e6-43a6-959a-e41fb1ae8a25 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:21.310641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:21.311849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 12:10:21.312906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:21.313904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 471/912] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 28 12:10:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:21.319929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.375612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496b1f-2562-4180-bdc6-35f5e262a19d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.375959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496b1f-2562-4180-bdc6-35f5e262a19d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.376143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496b1f-2562-4180-bdc6-35f5e262a19d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.377815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 472/913] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:21.380011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:21.383416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.383688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.383966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.404412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:21.405646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:21.430517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:21.444261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d7f36-9388-4617-ba5d-f3f98447b392 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.482784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.483404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.483686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.484059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.484822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:21.485114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.486478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.491807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 442/914] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:21.492052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 473/915] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:21.497525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.602635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d26be8-ed85-4073-98cd-adb79a521fd9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.615956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:21.638354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.639284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.639791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.640254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.641093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:21.641606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.643147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.648466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 443/916] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:21.655149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.756735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f52ae-1761-4171-bc8e-acc546469f82 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.764517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.810310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.810918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.811188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.811451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.812126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.813502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.839213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 474/917] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:21.898068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd469-c457-406d-81ca-41e88d1d8192 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:21.944348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:21.945025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:21.945301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:21.945566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:21.946189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:21.947700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:21.957879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:21.958967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:21.959841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 444/918] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:21.970295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:21.981395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:22.084659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29d349-9e77-4932-b107-8a8e2813a849 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:22.120972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:22.121991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:22.122469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:22.122935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:22.123772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:22.124322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:22.125966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:22.131376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 475/919] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:22.137856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:22.174533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:22.248741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f4fd-9fb7-4c51-8e6b-5f0530e0ebcf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:22.287477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:22.288080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:22.288354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:22.288615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:22.289268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:22.289561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:22.290898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bef69-8baf-435a-96a8-bc73ece9b164 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:22.296451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 445/920] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 28 12:10:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:22.301915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:22.352733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe8dcf-ec4e-4a59-a08c-014a6010caac None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:22.353055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe8dcf-ec4e-4a59-a08c-014a6010caac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:22.353388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe8dcf-ec4e-4a59-a08c-014a6010caac None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:22.355466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 446/921] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:22.360820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117511-6261-4676-a894-baf63b76da37 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:22.361285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117511-6261-4676-a894-baf63b76da37 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:22.361710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117511-6261-4676-a894-baf63b76da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:22.380663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bb117511-6261-4676-a894-baf63b76da37 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:22.382641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb117511-6261-4676-a894-baf63b76da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:22.388393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:22.431001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05333dc-89b0-42d4-bf75-0e08d051ff35 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:22.470544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 447/922] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 28 12:10:22.472351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6fec7-2e07-458f-a3ec-c4f719314c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:22.473056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6fec7-2e07-458f-a3ec-c4f719314c2e None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:22.473403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6fec7-2e07-458f-a3ec-c4f719314c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:22.473757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6fec7-2e07-458f-a3ec-c4f719314c2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:22.474481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6fec7-2e07-458f-a3ec-c4f719314c2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:22.475950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6fec7-2e07-458f-a3ec-c4f719314c2e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:22.501442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 476/923] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:22.748740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117511-6261-4676-a894-baf63b76da37 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:22.779676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:22.854872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117511-6261-4676-a894-baf63b76da37 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:22.895037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8b98-f0a7-4261-a839-ebbaa499c6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:22.895640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8b98-f0a7-4261-a839-ebbaa499c6f5 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:22.895918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8b98-f0a7-4261-a839-ebbaa499c6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:22.896180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8b98-f0a7-4261-a839-ebbaa499c6f5 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:22.896840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8b98-f0a7-4261-a839-ebbaa499c6f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:22.898181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8b98-f0a7-4261-a839-ebbaa499c6f5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:22.917356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 448/924] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:22 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:23.562612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4b0a9-2f0d-4feb-a251-be38eac4b789 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:23.563154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4b0a9-2f0d-4feb-a251-be38eac4b789 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:23.563154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4b0a9-2f0d-4feb-a251-be38eac4b789 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:23.564704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 477/925] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:23.569745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:23.570149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:23.570290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:23.590074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:23.591244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:23.664635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 449/926] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:23.934362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4b0a9-2f0d-4feb-a251-be38eac4b789 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.046159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4b0a9-2f0d-4feb-a251-be38eac4b789 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.074744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:24.086560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368668f4-6762-43b1-985a-4f7886218691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.087671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368668f4-6762-43b1-985a-4f7886218691 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.088706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368668f4-6762-43b1-985a-4f7886218691 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.089357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368668f4-6762-43b1-985a-4f7886218691 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.102600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368668f4-6762-43b1-985a-4f7886218691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-368668f4-6762-43b1-985a-4f7886218691 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:24.107964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:24.108930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:24.109787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:24.112447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 478/927] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 28 12:10:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:24.117956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.132444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:24.203716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa36cf-e1aa-4dea-9511-899ec9f0ada3 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.203909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa36cf-e1aa-4dea-9511-899ec9f0ada3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.204170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa36cf-e1aa-4dea-9511-899ec9f0ada3 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.206067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 479/928] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:24.212195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.212477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.212800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.226608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4151be-68ea-4ab7-ad48-a239922dada7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.231760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:24.232973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:24.264301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.264938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.265212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.265571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.266259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:24.266620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:24.267962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:24.277120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 450/929] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:24.285816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.312902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 480/930] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:24.366628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:24.393760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af2db0-c19c-49a0-a1bf-044b5d2b7577 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.435382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.436004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.436277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.436541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.446863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:24.449032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:24.463712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:24.464650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:24.466320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:24.466320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:24.466320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:24.466320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 451/931] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:24.471084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.573530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939673-7938-4b2d-b265-9b4d37b512d3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.601212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:24.617679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.618271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.618719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.619190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.619939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:24.620565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.625310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:24.626748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:24.641496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 481/932] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:24.646894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.738113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c20f8-deb8-4a1d-9ab8-1c2ac4ac4fbd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.750783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb61b4b-5197-464a-a173-998efc0ce27a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.765727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:24.774957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.775710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.775987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.776253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.776916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:24.778286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:24.785590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.786217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.786493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.786763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f5a62cc0-4902-4bcb-9176-c1cd2ec3f3f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:24.787754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:24.788710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:24.789594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 452/933] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:24.790470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eec06-dc6c-4118-a466-4e7ff8f66eae None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.790540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eec06-dc6c-4118-a466-4e7ff8f66eae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.791861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eec06-dc6c-4118-a466-4e7ff8f66eae None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.797541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 453/934] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:24.800728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.800728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.800728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.804644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:24.805959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:24.818949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:24.819894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 482/935] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:24.820870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.826243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:24.826704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:24.859596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:24.902856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 454/936] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:24.907970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:24.932282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91247e7c-04e9-4fbc-917f-9a6e9004a537 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:24.968290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:24.969525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:24.969914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:24.970288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:24.971290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:24.971712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:24.973647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:24.984921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 483/937] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:24.986553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.033712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953eb0c-ba48-46d1-9e25-63f92f144006 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.057359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.068492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.069216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.069565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.069927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.070731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:25.071327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.073376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.095887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 455/938] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:25.097060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.105223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.110070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dfbc8-93d6-4432-97b9-860ac5a8eb14 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.149727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.151388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.152011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.152761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.153660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:25.154152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.156121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.162943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 484/939] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:25.197642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.214348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bf747-1250-49b4-81c1-8200558c15c2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.257094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.257737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.258013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.258280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.269703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.271158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6b5ebcb3-9f4d-4fa6-9d8d-4e31dc62fb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:25.287607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:25.288606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:25.289542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:25.289542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:25.289542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:25.289542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 456/940] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:25.290210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725943f-c29a-45b1-8051-ee20f02e9b96 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.290310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725943f-c29a-45b1-8051-ee20f02e9b96 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.290973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725943f-c29a-45b1-8051-ee20f02e9b96 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.296254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 457/941] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:25.297654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.297941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.298234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.317034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:25.318264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:25.324061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7ded8-f998-4515-a93a-f3460c7c37dd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.344761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.367962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.368566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.368865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.369860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.370583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.372038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.374640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING keystone.server.flask.common [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 28 12:10:25.393535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.sql.core [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 12:10:25.393535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 28 12:10:25.393535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [parameters: {'id': 'bfadb5447a9540dc8a4b503da07b1971', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 28 12:10:25.393535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81473) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 12:10:25.397893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 458/942] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:25.405751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bfadb5447a9540dc8a4b503da07b1971.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bfadb5447a9540dc8a4b503da07b1971. Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:10:25.410019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result.read() Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 28 12:10:25.410877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application yield resource Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise self.value Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application session.commit() Sep 28 12:10:25.411819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.session.flush() Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application compat.raise_( Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 12:10:25.412742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 12:10:25.414355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application result.read() Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:10:25.415180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [parameters: {'id': 'bfadb5447a9540dc8a4b503da07b1971', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.418292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:25.420339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bfadb5447a9540dc8a4b503da07b1971. Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 485/943] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 28 12:10:25 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:25.421860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.444432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.531808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50676-8a1d-4d7d-aff9-cfee0df66494 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.563113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa205-5aef-4bff-a794-b02d63e2071f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.582714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.583645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.584144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.584615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.585518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:25.586018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.587570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.600284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.600808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.601093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.601498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.601718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 459/944] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:25.612979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.613165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.613165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:25.622635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:25.623685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:25.624653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 486/945] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:25.630383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.637533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.732415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.738262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128fba3-6245-417a-9c43-47680bec9820 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.753783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4311-559c-40b3-8bcf-524ed1321cac None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.774312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.775051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.775975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.776315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.782963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.784460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.789245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.789921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.790275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.790637 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.792100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:25.792507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.795867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:25.797090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:25.798154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:25.799253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:25.807994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 460/946] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:25.807994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.833766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 487/947] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:25.834687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:25.905428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:25.933430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97e5d-32a6-4551-b457-b93f22b5d90d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.977125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7b25-b52f-4e82-b544-0dbdf74073d4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:25.983035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:25.983680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:25.983963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:25.984230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:25.984843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:25.986214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:25.999433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:26.000588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:26.001515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 461/948] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:26.007992 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:26.030122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:26.030753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:26.030998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:26.031263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:26.032062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:26.032360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:26.034892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:26.044354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:26.048823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 488/949] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:26.054737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:26.157154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f4def-9a04-4cf8-b372-63d9992f360c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:26.177422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b6b9-674b-433a-b264-0ae0bc3db05b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:26.201041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:26.201786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:26.202168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:26.202540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:26.203264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:26.203688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:26.205638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:26.216760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 462/950] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:26.217831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:26.220629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:26.221618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:26.222082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:26.222509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/586cf4918eee4d13be7cc1adc56d8128/roles/969d2ab6c29940dfb70871d5a27baf8d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:26.224976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=586cf4918eee4d13be7cc1adc56d8128, role_id=969d2ab6c29940dfb70871d5a27baf8d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:26.226879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:26.229883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:26.247116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 489/951] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:10:26 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/586cf4918eee4d13be7cc1adc56d8128/roles/969d2ab6c29940dfb70871d5a27baf8d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:10:26.335412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d570a87-8f13-4348-af9d-8c2c6a82385e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:26.373886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:26.374512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:26.374791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:26.375062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:26.375717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:26.376022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:26.377526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:26.383566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 463/952] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:26.389821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:26.456935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:26.502235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97502d1-664d-4e3f-9b45-d4dce1ffadb2 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:26.542179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:26.542784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:26.543056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:26.543322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:26.544012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] RBAC: Adding query filter params (interface=public, service_id=e17eb565e97b4d678da4e4d20e091cf7, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:26.544314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:26.545702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2474-1e51-4c25-9106-a3658a1110ed None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:26.551305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 490/953] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:26 2022] GET /identity/v3/endpoints?service_id=e17eb565e97b4d678da4e4d20e091cf7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:26.557219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:26.637154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:26.663227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1833c18-14b9-4831-8e60-05230520e853 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:26.699325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b263d3-6ead-408f-8f98-bf58d3d66fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:26.699944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b263d3-6ead-408f-8f98-bf58d3d66fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:26.700284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b263d3-6ead-408f-8f98-bf58d3d66fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:26.700558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b263d3-6ead-408f-8f98-bf58d3d66fd7 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:26.701192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b263d3-6ead-408f-8f98-bf58d3d66fd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:26.702586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b263d3-6ead-408f-8f98-bf58d3d66fd7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:26.709479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 464/954] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:26 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:10:27.404955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3531-6d92-4941-93d0-4c6b4f26dd49 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:27.405956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3531-6d92-4941-93d0-4c6b4f26dd49 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:27.406486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3531-6d92-4941-93d0-4c6b4f26dd49 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:27.408289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 491/955] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:27.413797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c10185-19fe-4ca8-bab2-c20c4c3a18c3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:27.414435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c10185-19fe-4ca8-bab2-c20c4c3a18c3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:27.414901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c10185-19fe-4ca8-bab2-c20c4c3a18c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:27.434187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-47c10185-19fe-4ca8-bab2-c20c4c3a18c3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:27.435761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-47c10185-19fe-4ca8-bab2-c20c4c3a18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:27.505201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 465/956] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:27.779586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3531-6d92-4941-93d0-4c6b4f26dd49 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:27.896388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3531-6d92-4941-93d0-4c6b4f26dd49 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:27.921884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:27.933510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d145d-ae63-4627-b764-54dd294e9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:27.934113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d145d-ae63-4627-b764-54dd294e9b22 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:27.934383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d145d-ae63-4627-b764-54dd294e9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:27.934646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d145d-ae63-4627-b764-54dd294e9b22 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:27.935302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d145d-ae63-4627-b764-54dd294e9b22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:27.936638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d145d-ae63-4627-b764-54dd294e9b22 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:27.955219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 492/957] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:27 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:28.187486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c017b00-b90a-4252-a7b4-164fff0e3584 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:28.187994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c017b00-b90a-4252-a7b4-164fff0e3584 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:28.188080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c017b00-b90a-4252-a7b4-164fff0e3584 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:28.189699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 466/958] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:28.195041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c89-0dcd-4475-ad8b-3a85353a461a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:28.195330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c89-0dcd-4475-ad8b-3a85353a461a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:28.195601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c89-0dcd-4475-ad8b-3a85353a461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:28.214810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d60a0c89-0dcd-4475-ad8b-3a85353a461a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:28.216389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d60a0c89-0dcd-4475-ad8b-3a85353a461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:28.296904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 493/959] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:28.517326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a96db-7d54-4793-be3e-9fc0a725d30d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:28.518101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a96db-7d54-4793-be3e-9fc0a725d30d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:28.518604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a96db-7d54-4793-be3e-9fc0a725d30d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:28.520380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 467/960] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:28.526044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:28.526886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:28.527356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:28.546656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:28.548154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:28.564796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a96db-7d54-4793-be3e-9fc0a725d30d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:28.631661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 494/961] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:28.639366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:28.678370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a96db-7d54-4793-be3e-9fc0a725d30d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:28.714823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:28.715798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:28.716273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:28.716736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:28.717662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:28.719445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:28.722186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING keystone.server.flask.common [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 28 12:10:28.735502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 12:10:28.735502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 28 12:10:28.735502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [parameters: {'user_id': '6dfa1b935c3445fd854c51c1aba29f81', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 28 12:10:28.735502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 28 12:10:28.743391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:10:28.744300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 12:10:28.745329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 12:10:28.747017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 12:10:28.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 12:10:28.750950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'user_id': '6dfa1b935c3445fd854c51c1aba29f81', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:28.752995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 28 12:10:28.754935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:28.757287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 468/962] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 28 12:10:28 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:28.761538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:28.810055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:28.882093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c676c-9435-4bec-bcd1-f00465f3bc94 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:28.910167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:28.920647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:28.921671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:28.922588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:28.923054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:28.934830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:28.937710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:28.955719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:28.956735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 12:10:28.957753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:28.959240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 495/963] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:28.964600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.029061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e06f83-f356-4523-9020-286d832b0431 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.061751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:29.062960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:29.066086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b8644-96ff-4d45-8d86-d578003985b7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.073250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e952151-a074-4c59-87c6-955c872187cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.073982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952151-a074-4c59-87c6-955c872187cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.074730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952151-a074-4c59-87c6-955c872187cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.075111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e952151-a074-4c59-87c6-955c872187cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.086284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e952151-a074-4c59-87c6-955c872187cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3e952151-a074-4c59-87c6-955c872187cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:29.091685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:29.092835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:29.093865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:29.100214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 469/964] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 28 12:10:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:29.100214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2281a-17f7-4214-be3f-f8d25caf8973 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.100214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2281a-17f7-4214-be3f-f8d25caf8973 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.100214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2281a-17f7-4214-be3f-f8d25caf8973 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.102040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 470/965] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:29.106909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2281a-17f7-4214-be3f-f8d25caf8973 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.110238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.110843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.111141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.111397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.112103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:29.112404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.113864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca0d6-de2f-4192-8355-00441c34815f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.151038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 496/966] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 28 12:10:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:29.154697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.155246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.155772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.182767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:29.185324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:29.233852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2281a-17f7-4214-be3f-f8d25caf8973 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.276831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 497/967] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:29.286475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.287460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.287895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.288336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.289203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:29.289691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.292470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.302374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 471/968] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:29.308984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.404095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:29.416804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95388d-58be-412f-b163-4bbaae8fc97e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.453671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.454354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.454647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.454902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.466384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.467851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:29.483477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:29.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:29.485978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:29.485978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:29.485978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:29.485978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 498/969] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:29.490366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.546877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:29.566460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.601304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409da58-19e1-4f4d-9d00-bc748b0cdd36 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.638851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.639586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.639962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.640327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.641126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:29.641543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.642993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.656758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 472/970] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:29.661809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.677750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f9dd4-592c-488e-9df0-4d67aa190830 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.714231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.714852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.715127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.715393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.715978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.717371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:29.726298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:29.727486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:29.728982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 499/971] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:29.734083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.739096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:29.777994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416d420-06e8-4045-83cb-6a6b8fba3ade None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.792184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:29.821057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.822473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.822754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.823021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.830981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.832394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.843685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181fcc-99c3-44d8-9727-3eccc2c43053 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:29.844580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:29.845570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:29.846546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 473/972] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:29.851529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.881311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:29.881916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:29.882193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:29.882467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:29.883099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:29.883406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:29.885341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:29.894860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 500/973] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:29.895821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:29.963264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2916-1b0e-479f-9e95-d5466c403bac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:29.967330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.001864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.002469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.002748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.003017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.003440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051642f4-50d7-463c-9fbb-702e4a96430e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.003745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:30.004047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.005495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.027814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 474/974] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:30.029124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.047429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.048083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.048355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.048618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.049316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:30.049608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.050950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.061312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 501/975] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:30.062488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.062996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.139031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdd939-1aa1-4de6-8d19-57a51d7ed41f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.178600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7714ca-60c7-4683-aee1-659756e03e77 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.181014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.181725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.182018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.182279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.212937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.219630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90630cfe-eb1b-44bc-96e2-53e5d8547eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.220165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630cfe-eb1b-44bc-96e2-53e5d8547eaf None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.220437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630cfe-eb1b-44bc-96e2-53e5d8547eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.220831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630cfe-eb1b-44bc-96e2-53e5d8547eaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.221556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90630cfe-eb1b-44bc-96e2-53e5d8547eaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.222915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90630cfe-eb1b-44bc-96e2-53e5d8547eaf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.245684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 502/976] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:30.254806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21252021-fa87-42f1-a941-cd84b9f12244 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.255148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21252021-fa87-42f1-a941-cd84b9f12244 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.255344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21252021-fa87-42f1-a941-cd84b9f12244 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.256981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 503/977] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:30.263367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0d536-a628-4251-862b-27eedf92641a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.263701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0d536-a628-4251-862b-27eedf92641a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.263913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0d536-a628-4251-862b-27eedf92641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.267037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.268546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.284644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aee0d536-a628-4251-862b-27eedf92641a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:30.285920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aee0d536-a628-4251-862b-27eedf92641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:30.301365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.365301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 504/978] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:30.390740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 475/979] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:10:30.392084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0d536-a628-4251-862b-27eedf92641a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.499516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0d536-a628-4251-862b-27eedf92641a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.514731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.536105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.536733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.537021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.537293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.547781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.549257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:30.564216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:30.565155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:30.566041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:30.566041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:30.566041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:30.566041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 505/980] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:30.571323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.638315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.672154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38197-3805-4fa6-a713-4ae99fa8cb40 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.702276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.710288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.710885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.711159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.711424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.712056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:30.712348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.713932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.725367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 476/981] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:30.731630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.750809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722bcdb-836a-4325-a951-be6fa4add73d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.785142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.785762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.786035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.786301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.786866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.788216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:30.797899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:30.798920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:30.804850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 506/982] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:30.807958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.845820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbf1d5-2497-44b8-9c54-9148f0fc8d5e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.846010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.883647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.884282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.884622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.884932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.891538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.892991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:30.904767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:30.905722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:30.906613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 477/983] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:30.911459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:30.925490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8b25c-7c03-45b2-b08a-fc834860a9ac None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:30.959003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:30.964617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:30.965549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:30.966024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:30.966495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:30.967310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:30.967852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:30.969416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:30.974601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 507/984] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:30.980748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:31.011420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e31c1-da66-4cf3-bfbf-1f6bfa478eaf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:31.046610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:31.047212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:31.047487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:31.047752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:31.048433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:31.048731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:31.050156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:31.063126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 478/985] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:31.068987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:31.081547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:31.089638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89407b02-abc7-4550-88a8-b2c628832189 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:31.125378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:31.126065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:31.126401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:31.126732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:31.127424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:31.127778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:31.129156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:31.139788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 508/986] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:31.141125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:31.182559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab9e01-eb24-402d-9824-aeb15d3c3fdf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:31.191707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:31.218095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:31.218703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:31.218979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:31.219247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:31.219968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] RBAC: Adding query filter params (role.id=969d2ab6c29940dfb70871d5a27baf8d, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=586cf4918eee4d13be7cc1adc56d8128) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:31.220271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:31.221722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:31.232805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 479/987] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:31 2022] GET /identity/v3/role_assignments?user.id=586cf4918eee4d13be7cc1adc56d8128&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=969d2ab6c29940dfb70871d5a27baf8d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:31.257212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476efdd-e510-4356-94bb-12902356a860 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:31.295901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:31.296505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:31.296870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:31.297197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:31.297969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] RBAC: Adding query filter params (interface=public, service_id=bbd3089d50134b87a6a7a50d9bd8fcfc, region_id=RegionOne) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:31.298338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:31.299789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb7d6-100e-42f4-be13-6f0e6f5c14f2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:31.305929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 509/988] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:31 2022] GET /identity/v3/endpoints?service_id=bbd3089d50134b87a6a7a50d9bd8fcfc&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:31.311662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:31.423738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca6766-90fa-4a92-b4d2-388ef0614cd9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:31.459776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5de9d1-2e60-4e42-ad0a-89ef5dfea5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:31.460374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5de9d1-2e60-4e42-ad0a-89ef5dfea5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:31.460651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5de9d1-2e60-4e42-ad0a-89ef5dfea5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:31.460934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5de9d1-2e60-4e42-ad0a-89ef5dfea5a4 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:31.461781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5de9d1-2e60-4e42-ad0a-89ef5dfea5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:31.463567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5de9d1-2e60-4e42-ad0a-89ef5dfea5a4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:31.470482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 480/989] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:31 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:10:32.433381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486bbc0-0852-44ab-8ddb-c94a930709f8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:32.433905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486bbc0-0852-44ab-8ddb-c94a930709f8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:32.433905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486bbc0-0852-44ab-8ddb-c94a930709f8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:32.435384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 510/990] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:32.440461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:32.440978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:32.441065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:32.460035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:32.461690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:32.491442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:32.531805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 481/991] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:32.798029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486bbc0-0852-44ab-8ddb-c94a930709f8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:32.825824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:32.904303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486bbc0-0852-44ab-8ddb-c94a930709f8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:32.938739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:32.939358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:32.939630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:32.939895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:32.940468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:32.941876 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:32.950547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:32.951529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:32.952379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:32.956734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 511/992] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:32.957997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:33.059166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa7dc-4db6-4f61-a7c3-2bc7f490756b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:33.093203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:33.093812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.094091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.094361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.094988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:33.095285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:33.096637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:33.106643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 482/993] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:33.108222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:33.195654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:33.211572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02df2-0beb-43ff-9d09-06cf849d9c0b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:33.245263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:33.245863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.246137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.246404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.247031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:33.247329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:33.248676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:33.253616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 512/994] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:33.259471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:33.290236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:33.365502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cbeda-b1b8-4b32-8972-e03af302513d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:33.399577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:33.400835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.401201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.401392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.402092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] RBAC: Adding query filter params (interface=admin, service_id=e17eb565e97b4d678da4e4d20e091cf7, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:33.402396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:33.403734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3971c-795a-4255-b102-8d04b492e973 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:33.409047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 483/995] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Sep 28 12:10:33 2022] GET /identity/v3/endpoints?service_id=e17eb565e97b4d678da4e4d20e091cf7&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:33.414651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:33.455124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993524-b543-4c92-8da0-412c25b3d80d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.455910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993524-b543-4c92-8da0-412c25b3d80d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.455910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993524-b543-4c92-8da0-412c25b3d80d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.457292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 484/996] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:33.462812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dedfe-81ed-4d34-a5b4-ce9b1207f9b5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.463306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dedfe-81ed-4d34-a5b4-ce9b1207f9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.463661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dedfe-81ed-4d34-a5b4-ce9b1207f9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.482941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-569dedfe-81ed-4d34-a5b4-ce9b1207f9b5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:33.484118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-569dedfe-81ed-4d34-a5b4-ce9b1207f9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:33.533699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004656ce-f291-4f39-b6f2-74d0d31bb12a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:33.559740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 485/997] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:33.575806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930addf-b188-496d-85d3-8c4a498c01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:33.576645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930addf-b188-496d-85d3-8c4a498c01d7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.577076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930addf-b188-496d-85d3-8c4a498c01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.577392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930addf-b188-496d-85d3-8c4a498c01d7 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.578329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930addf-b188-496d-85d3-8c4a498c01d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:33.580077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930addf-b188-496d-85d3-8c4a498c01d7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:33.596804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 513/998] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:33 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:10:33.646572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb7822-59b5-4bc8-9474-87b9c31f0628 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.646779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb7822-59b5-4bc8-9474-87b9c31f0628 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.647020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb7822-59b5-4bc8-9474-87b9c31f0628 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.648399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 486/999] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:33.655463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.655752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.656013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.674955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:33.676162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:33.687631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:33.757441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 514/1000] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:33.835154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb7822-59b5-4bc8-9474-87b9c31f0628 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:33.861277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:33.939720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb7822-59b5-4bc8-9474-87b9c31f0628 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:33.974423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:33.975091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:33.975368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:33.975633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:33.976254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:33.977622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:33.986555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:33.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:33.988412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:33.992450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 487/1001] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 28 12:10:33 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:33.993463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:34.028933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:34.095438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc6a02-b470-421b-9237-c64250730799 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:34.125779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:34.133075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:34.133685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:34.133958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:34.134932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:34.135567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:34.135866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:34.137265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:34.140085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcfe3-7578-47f9-b98b-d8de66faea77 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:34.142401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 515/1002] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:34.147725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:34.159231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:34.176317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:34.176975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:34.177251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:34.177517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:34.178086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:34.179490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:34.188460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:34.193508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:34.194393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 488/1003] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:34.196004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:34.257351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0400bf-ed70-494f-92a1-93491415dfa7 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:34.294518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:34.295120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:34.295391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:34.295652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:34.296274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] RBAC: Adding query filter params (type=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:34.296567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:34.297955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:34.312811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 516/1004] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:34.313025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c325-a3a5-4506-b96c-85f9b72d27d1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:34.345428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:34.346042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:34.346316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:34.346578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:34.347209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:34.347502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:34.348878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:34.359159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 489/1005] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:34.360500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:34.435745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:34.471001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b33b3-5c89-435c-8b08-658d3e85ce6a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:34.513206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:34.513808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:34.514076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:34.514338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:34.515260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:34.515649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:34.517111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376b1c-1353-4e1c-b6ee-c0e02e007059 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:34.522262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 517/1006] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 28 12:10:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:34.528536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:34.547738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:34.630311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975259be-8dda-4e0d-a5a2-4790848c24cd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:34.663706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045eae6-49b5-490a-9731-28fab535b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:34.664301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eae6-49b5-490a-9731-28fab535b8b7 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:34.664574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eae6-49b5-490a-9731-28fab535b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:34.664863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eae6-49b5-490a-9731-28fab535b8b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:34.666094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045eae6-49b5-490a-9731-28fab535b8b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:34.667444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045eae6-49b5-490a-9731-28fab535b8b7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:34.692826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 490/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:35.777591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9837-98d3-4858-a692-2b76eaa61e7a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:35.778146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9837-98d3-4858-a692-2b76eaa61e7a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:35.778146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9837-98d3-4858-a692-2b76eaa61e7a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:35.779584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 518/1008] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:35.784559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:35.784979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:35.785157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:35.806433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:35.807862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:35.875641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:35.884832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 491/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:35 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:36.153497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9837-98d3-4858-a692-2b76eaa61e7a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:36.257147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9837-98d3-4858-a692-2b76eaa61e7a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:36.290746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:36.291430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.291701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.291964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.292534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:36.293906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:36.296433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:36.304114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:36.305353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 12:10:36.306998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:36.311022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 519/1010] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 28 12:10:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:36.311838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:36.415598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397bb73-2e26-4bec-a6ce-e1849a4773b3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:36.450246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:36.450857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.451129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.451392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.452010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:36.452303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:36.453734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be5b9a-d55f-45f3-9b00-a664cd483bef None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:36.458891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 492/1011] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:36.465388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:36.490130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06da4-a49d-4ac8-b69c-ad7f49a4b139 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.490449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06da4-a49d-4ac8-b69c-ad7f49a4b139 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.490667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06da4-a49d-4ac8-b69c-ad7f49a4b139 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.492182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 493/1012] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:36.497501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.497779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.498047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.516275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:36.517467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:36.570867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565a1ff-ee0d-49bf-975f-544584950d14 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:36.576616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:36.589029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 494/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:36 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:36.606508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:36.607112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.607401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.607650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.608272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:36.608570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:36.609959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:36.614916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 520/1014] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 28 12:10:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:36.621009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:36.718474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896766-9aed-49e1-96e7-3093f73bb374 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:36.751738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf93cf4-3a95-4b34-98f0-d485a2ecea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:36.752332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf93cf4-3a95-4b34-98f0-d485a2ecea74 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.752604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf93cf4-3a95-4b34-98f0-d485a2ecea74 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.752892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf93cf4-3a95-4b34-98f0-d485a2ecea74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.753541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf93cf4-3a95-4b34-98f0-d485a2ecea74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:36.754939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf93cf4-3a95-4b34-98f0-d485a2ecea74 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:36.771558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 495/1015] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:36.861573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:36.932025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:36.970095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3872e01-0573-492f-a858-89334b61ed18 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.970595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3872e01-0573-492f-a858-89334b61ed18 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.970595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3872e01-0573-492f-a858-89334b61ed18 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.971884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 496/1016] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:36.977160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:36.977441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:36.977553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba67e34-e0c3-4419-99f8-0d6193da9c2f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:36.977794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:36.997862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:36.999059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:37.018988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:37.019579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:37.019850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:37.020121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:37.020752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:37.022124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:37.037812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 521/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:36 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:37.053274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:37.087781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 497/1018] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:37.365579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:37.465608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50085-c03b-472d-a097-7487cc671d40 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:37.485298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:37.500278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:37.500938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:37.501217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:37.501487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:37.512929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:37.517723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:37.518663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:37.519514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:37.520854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 522/1019] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 28 12:10:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:37.526362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:37.625355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6af57a-f483-46c2-a0c4-5b79af77a166 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:37.658227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:37.658827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:37.659099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:37.659362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:37.660010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:37.660304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:37.661674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:37.674246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 498/1020] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:10:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:37.675410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:37.781471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00f19-cb88-47fc-ac73-6ada13d0d75e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:37.821548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:37.822789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:37.823065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:37.823335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:37.835105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:37.836554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:37.850702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:37.851641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:37.852530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:37.852530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:37.852530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:37.853331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 523/1021] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:37.857852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:37.901239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:37.963267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cbc0f-8d81-4abd-a214-f2bcac1b9dcd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:37.999469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:38.000114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.000337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.000599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.001265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:38.001566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:38.002910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:38.015019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 499/1022] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:38.020387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:38.052366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:38.122233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a25c29-9e1e-4dfe-a5c5-aa004014ce2c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:38.154520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:38.155072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.155348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.155615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.162852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:38.164278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:38.175795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:38.176754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:38.177765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:38.181883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 524/1023] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:10:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:38.183257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:38.277941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:38.281574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557bf1-d2e2-4d85-b605-3b74ba7372a9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:38.316550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:38.317187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.317466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.317736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.318457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:38.318759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:38.320160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:38.342730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 500/1024] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:10:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:38.344328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:38.438096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:38.448026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dc21e-df1b-45d7-910d-d0bbb559d24f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:38.482913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:38.483515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.483792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.484063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.550585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:38.552023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:38.640313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:38.655802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 525/1025] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:38 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:38.657576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:38.759882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf2a4-954b-47f3-8b04-301da3d9363e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:38.796510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:38.797166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.797441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.797709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.809448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:38.810887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a1d7a14d-1eac-4c50-bf81-a90fe433c1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:38.826240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:38.827237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:38.828141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:38.828141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:38.828141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:38.829162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 501/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:38.833412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:38.938922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389c966-d4cb-4467-b1aa-0b02af6e1c35 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:38.973981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:38.974580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.974869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.975132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.975793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:38.976437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:38.977565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:38.978046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed1cb-bfeb-4c52-b84c-927bed29a49b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.978340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed1cb-bfeb-4c52-b84c-927bed29a49b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.978611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed1cb-bfeb-4c52-b84c-927bed29a49b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.980081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 502/1027] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:38.984970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:38.985253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:38.985519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:38.990335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 526/1028] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:38.996174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.003936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:39.005140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:39.008142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.057406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.077840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 503/1029] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:39.108301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d947cb5-2e7a-41b1-8cd3-c3dd6a1c0ff9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.144461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.145152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.145430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.145700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.153706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.155191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-30845ab0-f550-4b9c-b49b-42ba588f8efb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:39.168196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:39.169427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:39.170695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:39.173157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 527/1030] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:39.175697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.256043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96726e-04cc-4b78-85df-d1bf4a765e5c None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.256324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96726e-04cc-4b78-85df-d1bf4a765e5c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.256587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96726e-04cc-4b78-85df-d1bf4a765e5c None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.258185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 528/1031] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:39.263541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.263818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.264087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.280554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c333b-69f3-409d-8715-c43df57644e6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.282767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:39.283927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:39.319247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.319771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.320042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.320306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.321010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:39.321308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.323260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.332598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.336762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 504/1032] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:39.342455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.364352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 529/1033] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:39.365430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.409429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.448387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a8a1-e5e9-463e-80b4-be9159d1498c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.471078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56aec7-5849-49b8-be5d-b520dda7ec6a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.485608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.486478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.486478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.486786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.487441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] RBAC: Adding query filter params (role.id=969d2ab6c29940dfb70871d5a27baf8d, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=a5e487f1b5af4aa0a2d922d374adc29f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:39.487794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.489210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.494831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 505/1034] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:39 2022] GET /identity/v3/role_assignments?user.id=a5e487f1b5af4aa0a2d922d374adc29f&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=969d2ab6c29940dfb70871d5a27baf8d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:39.511628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.512330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.512604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.512948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.514156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.515649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.517544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 530/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:39.523245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.594148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.636544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24443db-38ab-46ec-baef-bdadde599c2f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.641890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.676853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.677263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.677544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.677806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.678455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.679919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.710910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 506/1036] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:10:39 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:39.758396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1972df1-2218-4c15-b7db-a0e951bbb122 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.771170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.809672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.810326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.810600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.810868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.811461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.812876 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:39.823485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:39.824585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:39.829833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 531/1037] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 28 12:10:39 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:39.831842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:39.942901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20005dfc-83f0-4c08-8f4e-e954cd8196d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:39.961703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:39.984150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:39.984759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:39.985064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:39.985328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:39.985953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:39.986247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:39.987675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:39.992883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 507/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:39.999248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:40.103799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db22a-1018-46b6-b0a8-dfdbc27101c1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:40.137965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:40.138567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:40.138838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:40.139103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:40.139728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] RBAC: Adding query filter params (type=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:40.140022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:40.141400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:40.146395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 532/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:40.152673 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:40.257295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403492-2ebc-43cf-bdbd-d95a608f69e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:40.291664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:40.292266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:40.292540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:40.292829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:40.293518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] RBAC: Adding query filter params (interface=public, service_id=ec7867a4d0b845ddb3f84beb483bd9b1, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:40.293819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:40.295155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4d75-8c29-4aa6-823e-94ea56edad60 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:40.306982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 508/1040] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:10:40 2022] GET /identity/v3/endpoints?service_id=ec7867a4d0b845ddb3f84beb483bd9b1&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:40.307144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:40.347440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:40.410517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b421-c2e5-44bd-a1b2-f4b0144d1971 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:40.445362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119361c6-bbd8-42d6-abba-20a15cb24b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:40.445964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119361c6-bbd8-42d6-abba-20a15cb24b68 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:40.446237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119361c6-bbd8-42d6-abba-20a15cb24b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:40.447193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119361c6-bbd8-42d6-abba-20a15cb24b68 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:40.447848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119361c6-bbd8-42d6-abba-20a15cb24b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:40.449230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119361c6-bbd8-42d6-abba-20a15cb24b68 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:40.463390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 533/1041] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:10:40 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:10:41.660843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215a5c-b783-4bb9-a071-ae8c069adcfb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:41.661356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215a5c-b783-4bb9-a071-ae8c069adcfb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:41.661467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52215a5c-b783-4bb9-a071-ae8c069adcfb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:41.663003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 509/1042] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:41.669024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50af4-9297-4af4-9158-717273bae5ce None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:41.669462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50af4-9297-4af4-9158-717273bae5ce None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:41.669635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50af4-9297-4af4-9158-717273bae5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:41.687738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-71a50af4-9297-4af4-9158-717273bae5ce None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:41.688957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-71a50af4-9297-4af4-9158-717273bae5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:41.756719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 534/1043] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:41.937101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7dc0-9863-478b-9ee6-bc619b0928b5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:41.937415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7dc0-9863-478b-9ee6-bc619b0928b5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:41.937584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7dc0-9863-478b-9ee6-bc619b0928b5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:41.939036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 510/1044] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:41.944124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:41.944405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:41.944672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:41.962919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:41.964073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:41.989666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.027197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e7dc0-9863-478b-9ee6-bc619b0928b5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.034839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 535/1045] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:42.077742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.133470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e7dc0-9863-478b-9ee6-bc619b0928b5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.167115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.167741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.168073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.168342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.178152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:42.182910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:42.183937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:42.184826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 511/1046] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:42.190065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.293219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45786-55e8-4fad-9313-9f5fda4e8a06 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.305175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.328116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.328714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.329422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.329707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.330801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:42.331099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:42.332458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:42.341143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 536/1047] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:42.346753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.373431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.414747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff9cc5-5e6c-4f21-ab68-dfcd0cff080f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.418109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.450333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6f677-a43d-4da5-b899-b2f1e10e56ce None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.451366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.452311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.453524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.453803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.454941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:42.456624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:42.460810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 512/1048] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:42.466016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.491497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.492421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.493449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.493970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.511684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:42.513205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:42.529826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:42.530887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:42.531766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:42.531766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:42.531766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:42.531766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 537/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:42.537037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.587604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e289e-1a43-474c-a786-04b14c15da48 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.618002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.623925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcd451-e9c8-4719-9603-4542fff8aa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.624529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcd451-e9c8-4719-9603-4542fff8aa50 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.624826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcd451-e9c8-4719-9603-4542fff8aa50 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.625095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcd451-e9c8-4719-9603-4542fff8aa50 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.625733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcd451-e9c8-4719-9603-4542fff8aa50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:42.627131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcd451-e9c8-4719-9603-4542fff8aa50 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:42.643271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cd769-6fad-46ae-bffb-b0a85b03de9b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.648661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 513/1050] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:10:42 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:42.650551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984763ae-76bd-4241-a6f5-b88ff522a82f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.650831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984763ae-76bd-4241-a6f5-b88ff522a82f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.651095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984763ae-76bd-4241-a6f5-b88ff522a82f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.652816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 514/1051] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:42.658366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.659394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.660004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.681100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.681707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:42.682068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.682068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.682402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.682944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:42.683073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:42.683251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:42.684642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:42.699939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 538/1052] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:42.706183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:42.710785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.776465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 515/1053] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:42.826193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfcd93-d3e1-4cc0-8761-576160d3831c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:42.862382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:42.863004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:42.863279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:42.863547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:42.866742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:42.873281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:42.874720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:42.887097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:42.888034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:42.889274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 539/1054] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:42.894081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.001108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0c15-6f52-4d2a-bfd4-4c7e87bc5f81 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.035201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.035802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.036073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.036333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.037206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:43.037506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.038904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.043207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.063976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 516/1055] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:10:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:43.065434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.085753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:43.148452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14bbe-a333-4f72-b678-edeb92a3b482 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.172314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23010e9a-7ee0-4bd1-9309-e9eb9974b61c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.187558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.188343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.188619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.188916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.189503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.190898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:43.200604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:43.209280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:43.211215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 540/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:43.213677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.218557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.219220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.219485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.219734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.230936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.232430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:43.248387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:43.249595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:43.250481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:43.250481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:43.250481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:43.250481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 517/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:43.255147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.278842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:43.324671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:43.330951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a4fea-cd24-4f20-aa80-a4e4c5a243c9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.362261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df878a53-e6a8-4bd1-9012-b5dc6423e15b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.366702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.367308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.367584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.367847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.369372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] RBAC: Adding query filter params (name=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:43.369677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.371033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.376020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 541/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:43.381531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.399741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.400344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.400626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.400922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.401559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:43.401858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.403212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.420708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 518/1059] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:43.421823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.494589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9242e-3601-4786-a7ad-c035af91262e None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.523173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:43.524819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0718-4f3e-45c4-9e12-829f8858a0c5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.537850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.538456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.538734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.539312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.539630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] RBAC: Adding query filter params (type=image) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:43.540463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.541870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.546722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 542/1060] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:43.552182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.559510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:43.568620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.569375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.569647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.569913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.577724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.579163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:43.593015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:43.594171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:43.595267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:43.597096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 519/1061] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:43.600042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.659573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76228-531e-4a6c-b92e-00e958b93b6c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.696523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.698217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.698217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.698217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.698477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.699882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.705944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51546688-7c9b-4ad1-b41d-415e25f0f2ee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.723443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 543/1062] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:10:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:10:43.758383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.759275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.759786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.760159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.761216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:43.761686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.763435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bafa10-0958-4272-b636-e4aaa5ba7b02 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.785357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 520/1063] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:43.787790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:43.845898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:43.909355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12f99-ea5d-428b-bbdd-ad4d034e76b0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:43.945797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4f044-f78a-40db-ad59-581540cc9baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:43.946521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4f044-f78a-40db-ad59-581540cc9baa None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:43.946799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4f044-f78a-40db-ad59-581540cc9baa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:43.947068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4f044-f78a-40db-ad59-581540cc9baa None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/a5e487f1b5af4aa0a2d922d374adc29f/roles/969d2ab6c29940dfb70871d5a27baf8d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:43.949266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4f044-f78a-40db-ad59-581540cc9baa None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=a5e487f1b5af4aa0a2d922d374adc29f, role_id=969d2ab6c29940dfb70871d5a27baf8d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:43.950704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4f044-f78a-40db-ad59-581540cc9baa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:43.965554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 544/1064] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:10:43 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/a5e487f1b5af4aa0a2d922d374adc29f/roles/969d2ab6c29940dfb70871d5a27baf8d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:10:44.893295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f1c2-d000-4f04-8908-f034ce680dfc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:44.893841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f1c2-d000-4f04-8908-f034ce680dfc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:44.893841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f1c2-d000-4f04-8908-f034ce680dfc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:44.895305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 521/1065] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:44.900348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d8738-6637-43f5-b178-64a2481762ba None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:44.900808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d8738-6637-43f5-b178-64a2481762ba None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:44.900912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d8738-6637-43f5-b178-64a2481762ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:44.919447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-722d8738-6637-43f5-b178-64a2481762ba None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:44.920614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-722d8738-6637-43f5-b178-64a2481762ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:44.989372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 545/1066] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:45.258056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f1c2-d000-4f04-8908-f034ce680dfc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:45.304754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:45.361357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f1c2-d000-4f04-8908-f034ce680dfc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:45.393382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:45.394003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:45.394276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:45.394539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:45.405584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:45.410312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:45.411249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:45.412164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:45.420230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 522/1067] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:45.420383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d8738-6637-43f5-b178-64a2481762ba None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:45.451891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:45.521333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d8738-6637-43f5-b178-64a2481762ba None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:45.555149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:45.555802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:45.556079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:45.556525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:45.557226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:45.557525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:45.558883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:45.571571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 546/1068] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:45.574422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:45.677494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e7e2-e625-44b6-8ac4-d17dd728de20 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:45.679917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:45.715291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7c854-3f96-4cfa-8517-df7cc464ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:45.715913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7c854-3f96-4cfa-8517-df7cc464ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:45.716187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7c854-3f96-4cfa-8517-df7cc464ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:45.716453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7c854-3f96-4cfa-8517-df7cc464ce75 None admin] PATH_INFO: `/v3/users/c66fda5ca4a0493b999364d0786b9373` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:45.730307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7c854-3f96-4cfa-8517-df7cc464ce75 None admin] RBAC: Authorizing `identity:get_user(user_id=c66fda5ca4a0493b999364d0786b9373)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:45.731725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7c854-3f96-4cfa-8517-df7cc464ce75 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:45.737140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 523/1069] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:10:45 2022] GET /identity/v3/users/c66fda5ca4a0493b999364d0786b9373 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:45.739048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:45.846606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:45.853479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae0e8-9a5c-4f52-bd65-cb0fbc559026 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:45.888702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f9ada-4df3-4720-a473-54d2002bfca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:45.889335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f9ada-4df3-4720-a473-54d2002bfca5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:45.889612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f9ada-4df3-4720-a473-54d2002bfca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:45.889882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f9ada-4df3-4720-a473-54d2002bfca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:45.941453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356e78-55e1-428b-ba57-dc322d24722e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:45.942006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356e78-55e1-428b-ba57-dc322d24722e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:45.942006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356e78-55e1-428b-ba57-dc322d24722e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:45.943453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 524/1070] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:45.948973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:45.949256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:45.949534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:45.960275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f9ada-4df3-4720-a473-54d2002bfca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:45.961838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f9ada-4df3-4720-a473-54d2002bfca5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:45.968007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:45.969228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:46.047799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 525/1071] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:46.062827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.075329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 547/1072] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:46.076736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.143310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759a54a-bc89-4769-9f5b-a46d69da5d32 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.143610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759a54a-bc89-4769-9f5b-a46d69da5d32 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.143852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759a54a-bc89-4769-9f5b-a46d69da5d32 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.145373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 548/1073] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:46.150219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.150499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.150771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.167899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.169211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:46.170396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:46.180128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5854-1dec-4683-94cc-14504bba8894 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.219806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910331-e471-4858-8ce2-643345c215ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:46.220432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910331-e471-4858-8ce2-643345c215ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.220840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910331-e471-4858-8ce2-643345c215ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.221112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910331-e471-4858-8ce2-643345c215ff None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.222351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910331-e471-4858-8ce2-643345c215ff None admin] RBAC: Authorizing `identity:get_project(project_id=7b8043c0150344939a9c4789d428ff39)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:46.223764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910331-e471-4858-8ce2-643345c215ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:46.231103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 526/1074] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/projects/7b8043c0150344939a9c4789d428ff39 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:46.232203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910331-e471-4858-8ce2-643345c215ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.244847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 549/1075] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:46.321851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.334637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910331-e471-4858-8ce2-643345c215ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.373455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:46.374052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.374330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.374600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.375319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=7b8043c0150344939a9c4789d428ff39, user.id=c66fda5ca4a0493b999364d0786b9373) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:46.375621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:46.377109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:46.388989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 527/1076] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/role_assignments?user.id=c66fda5ca4a0493b999364d0786b9373&scope.project.id=7b8043c0150344939a9c4789d428ff39&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:46.429924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcabaa1-9f35-498a-b752-7a4d730c1f3a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.458901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.470172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:46.470792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.471065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.471327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.513039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.542105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.550366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:46.551825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:46.624798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bdfea-67a4-4a0f-a018-fb0dd1118020 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.660147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 550/1077] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:10:46.661540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:46.662182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.662462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.662734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.665817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.675726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:46.681772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:46.682924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:46.683759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 528/1078] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:46.688631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.699885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.780630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.785650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327efe-f490-4e45-b458-f553d9311da3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.804264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d4ff8-9d31-4198-905b-30b7e9eb4ca7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.827251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:46.827932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.828157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.828426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.839456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:46.840924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:46.841033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:46.841624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:46.841897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:46.842161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:46.842812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:46.843104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:46.844425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:46.857529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 529/1079] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:46.857718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:46.858614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:46.859504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:46.859504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:46.859504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:46.859504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 551/1080] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:46.861949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.862950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:46.945341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:46.972617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1003-6177-4966-8d92-5c808395fe55 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:46.973402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282c99f-909b-4cff-bead-6f8237ccbbb2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:47.008143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.009268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.009542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.009806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:47.013174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.013775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.014050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.014315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:47.014948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:47.015247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:47.017040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:47.020377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:47.021816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:47.028925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:47.032862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 552/1081] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:47.041801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:47.042838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:47.043739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:47.043739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:47.043739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:47.044519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 530/1082] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:47.049035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:47.159421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86f02-b190-4a50-b00d-0e7768c68f08 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:47.195858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.197090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.197461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.197729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:47.198380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:47.198677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:47.200041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:47.208477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:47.215603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 553/1083] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:47.221409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:47.335223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cf3eb-700d-46a5-b6c1-931cefff29a5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:47.371214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.371838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.372110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.372376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:47.379937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:47.381446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:10:47.392909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:47.393864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:47.394801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 531/1084] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 28 12:10:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:47.400072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:47.497042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8fa4-7633-4406-99e4-4c6f121691b5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:47.529923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.530528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.530801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.531069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:47.531785 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:47.532086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:47.533529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:47.550094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 554/1085] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 28 12:10:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:47.556355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:47.614303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:47.655945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90b6bd-47f1-4bc5-a85d-032562155a7d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:47.689074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.689675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.689955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.690223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:47.754652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:47.756000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:47.814169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:47.856099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 532/1086] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:10:47.861838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:47.916963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:47.960067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fa12a-3fd1-46e2-a087-a7344e2a9fec None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:47.993664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:47.994285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:47.994560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:47.994830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.004611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:48.006137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:10:48.020973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:48.021999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:10:48.022886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:10:48.022886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:10:48.022886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:48.022886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 555/1087] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:10:48.027852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:48.124726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcd82c-2c9b-4282-8891-fd8f0e3ff2d6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:48.158031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:48.158629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:48.158906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:48.159176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.159807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:48.160109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:48.161485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:48.172808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 533/1088] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:48.178290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:48.275939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35573-487f-4c09-ab06-0ed85eff9151 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:48.284617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:48.309129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:48.309754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:48.310030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:48.310300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.316829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:48.318278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:10:48.329986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:48.331293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:48.337124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 556/1089] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:10:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:48.337618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:48.357061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:48.438295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d7f5-2389-4478-a4f4-766786dc53f8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:48.473835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:48.474437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:48.474715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:48.474982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.475658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:48.475958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:48.477923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7d48-118b-4990-b6e7-de116ca812f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:48.489878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 534/1090] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:48.496515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:48.543577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f71e5-46af-48d4-aed9-c699f7c9763c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:48.543774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f71e5-46af-48d4-aed9-c699f7c9763c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:48.544026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f71e5-46af-48d4-aed9-c699f7c9763c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.545395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 535/1091] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:10:48.550155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:48.550429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:48.550694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.569578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:48.570744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:48.596583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8ed8-6386-4d85-89d8-45dd4e20a1ae None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:48.629805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:48.633223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:48.633223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:48.633223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:48.633223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] RBAC: Adding query filter params (role.id=969d2ab6c29940dfb70871d5a27baf8d, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=a5e487f1b5af4aa0a2d922d374adc29f) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:48.633223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:48.634256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:48.639638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 536/1092] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:10:48.644833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 557/1093] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:48 2022] GET /identity/v3/role_assignments?user.id=a5e487f1b5af4aa0a2d922d374adc29f&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=969d2ab6c29940dfb70871d5a27baf8d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:48.918537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:48.928867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:49.022204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a39d7d-4ce8-4948-bf54-ace31d8bfa85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:49.058024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:49.058640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:49.058928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:49.059195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:49.069376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:49.074187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:49.075365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:10:49.076443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 537/1094] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:49.081875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:49.115881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:49.186084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748441aa-02f4-45ad-bb11-aa3b16a3fe7b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:49.220499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:49.221192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:49.221469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:49.221734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:49.222399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:49.222695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:49.224052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:49.233423 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 558/1095] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:49.239638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:49.311250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:49.343901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311dc15-4c45-4481-9cc6-08668f31acf4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:49.378028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:49.378649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:49.378929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:49.379193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] PATH_INFO: `/v3/users/c66fda5ca4a0493b999364d0786b9373` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:49.380305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] RBAC: Authorizing `identity:get_user(user_id=c66fda5ca4a0493b999364d0786b9373)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:49.381750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:49.383347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 538/1096] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:10:49 2022] GET /identity/v3/users/c66fda5ca4a0493b999364d0786b9373 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:49.389318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:49.486715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:49.494497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41711e-70fc-4ae4-96ed-9c51e01eeed3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:49.527900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038684-d3ef-49e7-ac63-f65b1d39687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:49.528520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038684-d3ef-49e7-ac63-f65b1d39687c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:49.528811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038684-d3ef-49e7-ac63-f65b1d39687c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:49.529082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038684-d3ef-49e7-ac63-f65b1d39687c None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:49.530181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12038684-d3ef-49e7-ac63-f65b1d39687c None admin] RBAC: Authorizing `identity:get_project(project_id=7b8043c0150344939a9c4789d428ff39)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:49.531595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12038684-d3ef-49e7-ac63-f65b1d39687c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:49.533240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 559/1097] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:10:49 2022] GET /identity/v3/projects/7b8043c0150344939a9c4789d428ff39 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:10:49.539288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:49.635171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c857c2-4bc6-4fec-9d81-48f0b263fa38 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:49.669820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2e3a7-2268-4782-9ce8-9445f83ef294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:49.670471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e3a7-2268-4782-9ce8-9445f83ef294 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:49.670750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e3a7-2268-4782-9ce8-9445f83ef294 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:49.671020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2e3a7-2268-4782-9ce8-9445f83ef294 None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39/users/c66fda5ca4a0493b999364d0786b9373/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:49.672899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2e3a7-2268-4782-9ce8-9445f83ef294 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8043c0150344939a9c4789d428ff39, user_id=c66fda5ca4a0493b999364d0786b9373, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:49.674313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2e3a7-2268-4782-9ce8-9445f83ef294 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:49.677276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:49.689297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 539/1098] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:10:49 2022] PUT /identity/v3/projects/7b8043c0150344939a9c4789d428ff39/users/c66fda5ca4a0493b999364d0786b9373/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:10:51.809532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c404-8cff-49c3-ba79-229ed8d8c125 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:51.809976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c404-8cff-49c3-ba79-229ed8d8c125 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:51.810076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734c404-8cff-49c3-ba79-229ed8d8c125 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:51.811382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 560/1099] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:51.816739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584608f3-a515-4794-aba4-d372c3069334 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:51.817142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584608f3-a515-4794-aba4-d372c3069334 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:51.817318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584608f3-a515-4794-aba4-d372c3069334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:51.835132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-584608f3-a515-4794-aba4-d372c3069334 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:51.836320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-584608f3-a515-4794-aba4-d372c3069334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:51.900841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 540/1100] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:52.174178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c404-8cff-49c3-ba79-229ed8d8c125 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:52.273446 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734c404-8cff-49c3-ba79-229ed8d8c125 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:52.306500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:52.307104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:52.307378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:52.307643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:52.317258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:10:52.323017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:10:52.324110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:10:52.324969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 561/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:10:52.330342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584608f3-a515-4794-aba4-d372c3069334 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:52.425101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584608f3-a515-4794-aba4-d372c3069334 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:52.453441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:52.462541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:52.463133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:52.463410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:52.463702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:52.464365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:52.464668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:52.466045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:52.473952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 541/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:52.480710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:52.505411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:52.577710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f4c22-2cab-4176-8665-f890f96a3475 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:52.610083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:52.610685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:52.610956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:52.611220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] PATH_INFO: `/v3/users/c66fda5ca4a0493b999364d0786b9373` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:52.612315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] RBAC: Authorizing `identity:get_user(user_id=c66fda5ca4a0493b999364d0786b9373)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:52.613747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:52.615278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 562/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:10:52 2022] GET /identity/v3/users/c66fda5ca4a0493b999364d0786b9373 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:52.621405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:52.716570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a453e-f36c-489c-b6da-ce3fc1aff327 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:52.748045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:52.748629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:52.748931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:52.749200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:52.800457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:52.813702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:52.815130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:52.909247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 542/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:52.915818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:53.003711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:53.014872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e7459-7584-4fb9-9306-481906e81677 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:53.047736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5dd5e-9eaa-4251-ba7f-8561fb056f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:53.048347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5dd5e-9eaa-4251-ba7f-8561fb056f0e None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:53.048621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5dd5e-9eaa-4251-ba7f-8561fb056f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:53.048924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5dd5e-9eaa-4251-ba7f-8561fb056f0e None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:53.050030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5dd5e-9eaa-4251-ba7f-8561fb056f0e None admin] RBAC: Authorizing `identity:get_project(project_id=7b8043c0150344939a9c4789d428ff39)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:53.051448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5dd5e-9eaa-4251-ba7f-8561fb056f0e None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:53.053092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 563/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:10:52 2022] GET /identity/v3/projects/7b8043c0150344939a9c4789d428ff39 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:53.059453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:53.143340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:53.155968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f092-a2a1-4d08-8317-b02c5cf3d7d0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:53.188507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:53.189167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:53.189442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:53.189706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:53.190407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=7b8043c0150344939a9c4789d428ff39, user.id=c66fda5ca4a0493b999364d0786b9373) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:53.190707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:53.192093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6e4d5-7c8c-4589-895c-c477daa2f3a5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:53.198255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 543/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:53 2022] GET /identity/v3/role_assignments?user.id=c66fda5ca4a0493b999364d0786b9373&scope.project.id=7b8043c0150344939a9c4789d428ff39&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:55.361868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064787-7125-4d23-a6e4-686ec199b2a8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:55.362433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064787-7125-4d23-a6e4-686ec199b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:55.362433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064787-7125-4d23-a6e4-686ec199b2a8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:55.363736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 564/1107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:55.369307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:55.369690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:55.369850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:55.387965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:55.389166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:55.452781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 544/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:55.723128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064787-7125-4d23-a6e4-686ec199b2a8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:55.821203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064787-7125-4d23-a6e4-686ec199b2a8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:55.853583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d9cf5-cf96-45df-9a0b-21e8439a952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:55.854194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9cf5-cf96-45df-9a0b-21e8439a952a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:55.854464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9cf5-cf96-45df-9a0b-21e8439a952a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:55.854727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9cf5-cf96-45df-9a0b-21e8439a952a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:55.855816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d9cf5-cf96-45df-9a0b-21e8439a952a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:55.857266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d9cf5-cf96-45df-9a0b-21e8439a952a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:55.858804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 565/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:55.864448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:55.940642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:55.958822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f62b2-2d2a-4659-92e9-160476469a0c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:55.991106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8f7b0-1b78-4cea-a480-31240fa0789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:55.991652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f7b0-1b78-4cea-a480-31240fa0789c None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:55.991910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f7b0-1b78-4cea-a480-31240fa0789c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:55.992174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f7b0-1b78-4cea-a480-31240fa0789c None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:55.993018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8f7b0-1b78-4cea-a480-31240fa0789c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:55.994413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8f7b0-1b78-4cea-a480-31240fa0789c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:56.015116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 545/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:10:55 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:10:58.200282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19cf03-219b-4231-afd1-29b2ac57c0f9 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:58.200862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19cf03-219b-4231-afd1-29b2ac57c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:58.200862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19cf03-219b-4231-afd1-29b2ac57c0f9 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:58.202171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 566/1111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:10:58.207579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:58.207944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:58.208119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:58.226418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:10:58.228110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:10:58.292060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 546/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:10:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:10:58.562961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19cf03-219b-4231-afd1-29b2ac57c0f9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:58.590065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:58.661145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19cf03-219b-4231-afd1-29b2ac57c0f9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:58.693915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:58.694524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:58.694798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:58.695066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] PATH_INFO: `/v3/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:58.696565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] RBAC: Authorizing `identity:get_role(role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:58.697950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:58.699248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 567/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:10:58 2022] GET /identity/v3/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:58.705249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:58.767164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:58.800464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53528d1-4cd7-46aa-ae3b-9f77b981e633 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:58.833391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:58.833948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:58.834218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:58.834479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] PATH_INFO: `/v3/users/163bcac60a6d41c78fe56fec3fce8ef7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:58.847639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] RBAC: Authorizing `identity:get_user(user_id=163bcac60a6d41c78fe56fec3fce8ef7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:58.849082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:58.850644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 547/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:10:58 2022] GET /identity/v3/users/163bcac60a6d41c78fe56fec3fce8ef7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:58.857115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:58.947468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:58.954260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ce93-3c3e-455a-a3cf-529290e9517f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:58.987444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:58.988025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:58.988293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:58.988550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:59.051522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:59.052962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:59.139444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:59.146759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 568/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:10:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:10:59.152831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:59.246443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc5d6e-16a3-4335-b3a3-fe4841ba6a48 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:59.270916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:10:59.279715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08121a3-db94-41b4-a398-59b34c8a28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:59.280329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08121a3-db94-41b4-a398-59b34c8a28dd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:59.280604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08121a3-db94-41b4-a398-59b34c8a28dd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:59.280894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08121a3-db94-41b4-a398-59b34c8a28dd None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:59.281998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08121a3-db94-41b4-a398-59b34c8a28dd None admin] RBAC: Authorizing `identity:get_project(project_id=7b8043c0150344939a9c4789d428ff39)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:59.283396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08121a3-db94-41b4-a398-59b34c8a28dd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:59.285041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 548/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:10:59 2022] GET /identity/v3/projects/7b8043c0150344939a9c4789d428ff39 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:10:59.291903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:10:59.387417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9487e-d6b9-4a8f-b599-b0937e5afac1 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:10:59.421016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:10:59.421533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:10:59.421802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:10:59.422064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:10:59.422771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] RBAC: Adding query filter params (role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=7b8043c0150344939a9c4789d428ff39, user.id=163bcac60a6d41c78fe56fec3fce8ef7) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:10:59.423070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:10:59.424466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c9826-fba1-40a1-8ba7-7bbea76806ba None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:10:59.429557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 569/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:10:59 2022] GET /identity/v3/role_assignments?user.id=163bcac60a6d41c78fe56fec3fce8ef7&scope.project.id=7b8043c0150344939a9c4789d428ff39&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:01.558763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd911bf-1f70-4f53-a1a3-3c33e5cf0614 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:01.559322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd911bf-1f70-4f53-a1a3-3c33e5cf0614 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:01.559322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd911bf-1f70-4f53-a1a3-3c33e5cf0614 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:01.560621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 549/1118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:01.565796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:01.566162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:01.566338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:01.584394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:01.585613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:01.636426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:01.650206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 570/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:01.923127 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd911bf-1f70-4f53-a1a3-3c33e5cf0614 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:02.021274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd911bf-1f70-4f53-a1a3-3c33e5cf0614 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:02.053453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:02.054055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:02.054326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:02.054621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] PATH_INFO: `/v3/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:02.056258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] RBAC: Authorizing `identity:get_role(role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:02.057613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:02.058888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 550/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:01 2022] GET /identity/v3/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:02.064528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:02.159238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f2652-512c-4130-8614-08be933a49f5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:02.191110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:02.191657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:02.191926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:02.192187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] PATH_INFO: `/v3/users/163bcac60a6d41c78fe56fec3fce8ef7` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:02.193299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] RBAC: Authorizing `identity:get_user(user_id=163bcac60a6d41c78fe56fec3fce8ef7)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:02.194693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:02.197317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 571/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:02 2022] GET /identity/v3/users/163bcac60a6d41c78fe56fec3fce8ef7 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:02.202860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:02.261849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:02.298395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be9174-203e-4541-8168-b5aad5982081 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:02.330855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455787d-0b9d-4a3e-b448-39fd27c7930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:02.331459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455787d-0b9d-4a3e-b448-39fd27c7930b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:02.331735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455787d-0b9d-4a3e-b448-39fd27c7930b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:02.332000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455787d-0b9d-4a3e-b448-39fd27c7930b None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:02.333244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455787d-0b9d-4a3e-b448-39fd27c7930b None admin] RBAC: Authorizing `identity:get_project(project_id=7b8043c0150344939a9c4789d428ff39)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:02.334651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455787d-0b9d-4a3e-b448-39fd27c7930b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:02.336952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 551/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:02 2022] GET /identity/v3/projects/7b8043c0150344939a9c4789d428ff39 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:02.342787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:02.396459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:02.438103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8932d-1cc2-48ec-a22a-a2aaf8dff18c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:02.471217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eb304-1877-428a-896d-947cbc6f3bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:02.471791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eb304-1877-428a-896d-947cbc6f3bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:02.472126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eb304-1877-428a-896d-947cbc6f3bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:02.472326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eb304-1877-428a-896d-947cbc6f3bd3 None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39/users/163bcac60a6d41c78fe56fec3fce8ef7/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:02.474471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eb304-1877-428a-896d-947cbc6f3bd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8043c0150344939a9c4789d428ff39, user_id=163bcac60a6d41c78fe56fec3fce8ef7, role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:02.476037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eb304-1877-428a-896d-947cbc6f3bd3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:02.488631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 572/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:11:02 2022] PUT /identity/v3/projects/7b8043c0150344939a9c4789d428ff39/users/163bcac60a6d41c78fe56fec3fce8ef7/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:11:04.765061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032642-db23-4e77-a909-d2d102c77673 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:04.765599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032642-db23-4e77-a909-d2d102c77673 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:04.765599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09032642-db23-4e77-a909-d2d102c77673 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:04.766933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 552/1124] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:04.772492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:04.772961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:04.773052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:04.792323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:04.793546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:04.864205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 573/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:11:05.177802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09032642-db23-4e77-a909-d2d102c77673 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:05.290630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09032642-db23-4e77-a909-d2d102c77673 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:05.323272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:05.329670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:05.330550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:05.330827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:05.331091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] PATH_INFO: `/v3/roles/0c13f14a58c54e48ba6a4e406f20a258` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:05.332567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] RBAC: Authorizing `identity:get_role(role_id=0c13f14a58c54e48ba6a4e406f20a258)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:05.333943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:05.335250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 553/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:05 2022] GET /identity/v3/roles/0c13f14a58c54e48ba6a4e406f20a258 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:05.344917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:05.390237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:05.441339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702bb5-940e-49ce-9416-3461503b5629 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:05.473917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:05.474532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:05.474804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:05.475071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] PATH_INFO: `/v3/users/163bcac60a6d41c78fe56fec3fce8ef7` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:05.476185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] RBAC: Authorizing `identity:get_user(user_id=163bcac60a6d41c78fe56fec3fce8ef7)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:05.477661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:05.479251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 574/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:05 2022] GET /identity/v3/users/163bcac60a6d41c78fe56fec3fce8ef7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:05.485072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:05.580038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2e08-b6ce-4b90-a6e9-eb8045678b25 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:05.611272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:05.611846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:05.612119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:05.612384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:05.671984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:05.676133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:05.677572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:05.772379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 554/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:11:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:11:05.778304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:05.875607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c3af3-54ab-4ca2-8c9b-78afe0b261b3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:05.889766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:05.909089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de9db2-4b2d-4023-85c9-859ce2c60a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:05.909696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9db2-4b2d-4023-85c9-859ce2c60a32 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:05.909967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9db2-4b2d-4023-85c9-859ce2c60a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:05.910230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9db2-4b2d-4023-85c9-859ce2c60a32 None admin] PATH_INFO: `/v3/projects/7b8043c0150344939a9c4789d428ff39` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:05.911324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de9db2-4b2d-4023-85c9-859ce2c60a32 None admin] RBAC: Authorizing `identity:get_project(project_id=7b8043c0150344939a9c4789d428ff39)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:05.912737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de9db2-4b2d-4023-85c9-859ce2c60a32 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:05.915239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 575/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:05 2022] GET /identity/v3/projects/7b8043c0150344939a9c4789d428ff39 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:05.921464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:06.015180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:06.019316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bfc69-0b60-4eeb-8fe8-79fa5bf40237 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:06.052955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:06.053478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:06.053755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:06.054019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:06.055333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] RBAC: Adding query filter params (role.id=0c13f14a58c54e48ba6a4e406f20a258, scope.project.id=7b8043c0150344939a9c4789d428ff39, user.id=163bcac60a6d41c78fe56fec3fce8ef7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:06.055629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:06.057062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d73b36-b392-44de-9689-bde094433e36 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:06.062562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 555/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:11:05 2022] GET /identity/v3/role_assignments?user.id=163bcac60a6d41c78fe56fec3fce8ef7&scope.project.id=7b8043c0150344939a9c4789d428ff39&role.id=0c13f14a58c54e48ba6a4e406f20a258 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:08.201178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a92a9-2a7c-4458-943d-bf978cbaa5e1 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:08.201752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a92a9-2a7c-4458-943d-bf978cbaa5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:08.201752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a92a9-2a7c-4458-943d-bf978cbaa5e1 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:08.203026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 576/1131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:08.208490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:08.208944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:08.209053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:08.227636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:08.228840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:08.292231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 556/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:08.563913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a92a9-2a7c-4458-943d-bf978cbaa5e1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:08.661140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a92a9-2a7c-4458-943d-bf978cbaa5e1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:08.693628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ab5bc-a77b-490a-9148-b02204f574d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:08.694229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ab5bc-a77b-490a-9148-b02204f574d5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:08.694499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ab5bc-a77b-490a-9148-b02204f574d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:08.694790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ab5bc-a77b-490a-9148-b02204f574d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:08.696610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ab5bc-a77b-490a-9148-b02204f574d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:08.698033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ab5bc-a77b-490a-9148-b02204f574d5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:08.699541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 577/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:08.705553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:08.792450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:08.801473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bdb60-8063-486c-8c97-6ae3d51b61e1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:08.835028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb099-6a70-49db-9039-b1afd6c53f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:08.835601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb099-6a70-49db-9039-b1afd6c53f4b None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:08.835907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb099-6a70-49db-9039-b1afd6c53f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:08.836247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb099-6a70-49db-9039-b1afd6c53f4b None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:08.836918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb099-6a70-49db-9039-b1afd6c53f4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:08.838338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb099-6a70-49db-9039-b1afd6c53f4b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:08.864845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 557/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:11:08 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:11:11.033264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca858e0-8efe-410e-8934-3e245d53180f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.033786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca858e0-8efe-410e-8934-3e245d53180f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.033786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca858e0-8efe-410e-8934-3e245d53180f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.035121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 578/1135] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:11.040571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.040987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.041158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.059763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:11.060975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:11.125140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 558/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:11.397312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca858e0-8efe-410e-8934-3e245d53180f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:11.447193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:11.497062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca858e0-8efe-410e-8934-3e245d53180f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:11.530372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd92df-2e29-4348-9ea3-eba10bd33ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:11.530985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd92df-2e29-4348-9ea3-eba10bd33ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.531260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd92df-2e29-4348-9ea3-eba10bd33ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.531527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd92df-2e29-4348-9ea3-eba10bd33ac2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.532623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd92df-2e29-4348-9ea3-eba10bd33ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:11.534068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd92df-2e29-4348-9ea3-eba10bd33ac2 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:11.535612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 579/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:11.542286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:11.613168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:11.637939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61eea7-1a38-438c-b838-a0ae3381266a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:11.670397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b860b02-d66a-499e-91a6-2a1426d4cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:11.670914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b860b02-d66a-499e-91a6-2a1426d4cac1 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:11.671186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b860b02-d66a-499e-91a6-2a1426d4cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:11.671448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b860b02-d66a-499e-91a6-2a1426d4cac1 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:11.672078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b860b02-d66a-499e-91a6-2a1426d4cac1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:11.673739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b860b02-d66a-499e-91a6-2a1426d4cac1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:11.693805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 559/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:11:11 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:11:13.873334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006866dd-263e-462e-9814-f19a9265c413 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:13.873801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006866dd-263e-462e-9814-f19a9265c413 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:13.873914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006866dd-263e-462e-9814-f19a9265c413 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:13.875175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 580/1139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:13.880561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:13.880990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:13.881131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:13.899393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:13.900554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:13.965810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 560/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:14.235902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006866dd-263e-462e-9814-f19a9265c413 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:14.333217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006866dd-263e-462e-9814-f19a9265c413 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:14.350236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:14.367553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:14.368174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:14.368450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:14.368719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:14.378933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:11:14.384324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:14.385552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:11:14.386468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 581/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:14.391539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:14.448116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:14.487855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3547a-81b7-4586-be38-d370f7e1df5d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:14.520830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:14.521418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:14.521689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:14.521950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:14.522619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:14.523091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:14.524522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:14.532100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 561/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:14.538003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:14.634105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632cba-f7d5-4836-a1ea-55c8214bb0c5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:14.665942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:14.666544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:14.666819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:14.667086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] PATH_INFO: `/v3/users/a644a8dcccff4d8ea258e99acb6cd1b7` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:14.680183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a644a8dcccff4d8ea258e99acb6cd1b7)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:14.681626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:14.683189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 582/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:14 2022] GET /identity/v3/users/a644a8dcccff4d8ea258e99acb6cd1b7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:14.688853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:14.784826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f1524-df2a-4df9-aaab-10c1b9236437 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:14.810524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:14.823289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:14.824102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:14.824480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:14.824932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:14.890782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:14.892206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:14.986646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 562/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:11:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:11:14.993375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:15.026093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:15.088626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f76d0d-be6b-45b9-8388-19d13923d4b4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:15.122306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768f66-6eb6-4cad-97f3-d6be5e29c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:15.122905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768f66-6eb6-4cad-97f3-d6be5e29c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:15.123176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768f66-6eb6-4cad-97f3-d6be5e29c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:15.123438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768f66-6eb6-4cad-97f3-d6be5e29c8a9 None admin] PATH_INFO: `/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:15.124521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768f66-6eb6-4cad-97f3-d6be5e29c8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=e43aa37e01a54ab28a01c558cc1e1ea5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:15.125965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768f66-6eb6-4cad-97f3-d6be5e29c8a9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:15.127543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 583/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:14 2022] GET /identity/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:11:15.133781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:15.156906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:15.229623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688db7d-4497-43c9-a701-5979061c3d7d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:15.261430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:15.262008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:15.262282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:15.262547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:15.263254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=e43aa37e01a54ab28a01c558cc1e1ea5, user.id=a644a8dcccff4d8ea258e99acb6cd1b7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:15.263549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:15.264963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f5b7-f901-4d0a-90cf-1ab9f76b52f1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:15.270050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 563/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:11:15 2022] GET /identity/v3/role_assignments?user.id=a644a8dcccff4d8ea258e99acb6cd1b7&scope.project.id=e43aa37e01a54ab28a01c558cc1e1ea5&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:17.393559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da54d-2e55-41b0-af7a-6e03b4cd45b9 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:17.394127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da54d-2e55-41b0-af7a-6e03b4cd45b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:17.394127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da54d-2e55-41b0-af7a-6e03b4cd45b9 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:17.395402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 584/1147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:17.401143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:17.401538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:17.401683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:17.419772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:17.420976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:17.490657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 564/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:17.761499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da54d-2e55-41b0-af7a-6e03b4cd45b9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:17.860341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da54d-2e55-41b0-af7a-6e03b4cd45b9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:17.862586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:17.893174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:17.893781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:17.894053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:17.894318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:17.904831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:11:17.909487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:17.910411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:11:17.911482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 585/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:17.916755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:17.933562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:18.014671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b14baa-f7aa-46d1-901b-b0543bd2c451 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:18.047163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:18.047747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:18.048020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:18.048282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:18.048958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:18.049252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:18.050579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:18.058446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 565/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:18.064176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:18.160449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456504ce-05c5-4602-8cad-17637e3dd9f3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:18.193323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:18.193935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:18.194210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:18.195228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] PATH_INFO: `/v3/users/a644a8dcccff4d8ea258e99acb6cd1b7` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:18.196467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] RBAC: Authorizing `identity:get_user(user_id=a644a8dcccff4d8ea258e99acb6cd1b7)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:18.197909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:18.199471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 586/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:18 2022] GET /identity/v3/users/a644a8dcccff4d8ea258e99acb6cd1b7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:18.205442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:18.280469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:18.300569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf153-41cc-494a-81c3-1358efc22ef7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:18.333535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6421-05ec-48b1-adf7-8d0943a5fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:18.334142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6421-05ec-48b1-adf7-8d0943a5fe74 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:18.334416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6421-05ec-48b1-adf7-8d0943a5fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:18.334678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6421-05ec-48b1-adf7-8d0943a5fe74 None admin] PATH_INFO: `/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:18.335756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de6421-05ec-48b1-adf7-8d0943a5fe74 None admin] RBAC: Authorizing `identity:get_project(project_id=e43aa37e01a54ab28a01c558cc1e1ea5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:18.337182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de6421-05ec-48b1-adf7-8d0943a5fe74 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:18.338772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 566/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:18 2022] GET /identity/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:18.344620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:18.375158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:18.441065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda8618-230c-459c-83b7-7c8842f97e9a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:18.473714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976e52b-0b31-407d-b295-f0bc80a5c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:18.474346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976e52b-0b31-407d-b295-f0bc80a5c32b None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:18.474620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976e52b-0b31-407d-b295-f0bc80a5c32b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:18.474886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976e52b-0b31-407d-b295-f0bc80a5c32b None admin] PATH_INFO: `/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5/users/a644a8dcccff4d8ea258e99acb6cd1b7/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:18.477314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976e52b-0b31-407d-b295-f0bc80a5c32b None admin] RBAC: Authorizing `identity:create_grant(project_id=e43aa37e01a54ab28a01c558cc1e1ea5, user_id=a644a8dcccff4d8ea258e99acb6cd1b7, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:18.478749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976e52b-0b31-407d-b295-f0bc80a5c32b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:18.492017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 587/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:11:18 2022] PUT /identity/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5/users/a644a8dcccff4d8ea258e99acb6cd1b7/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:11:20.618878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307435e-b04d-4ee4-9d5e-3b7dd7cb1e99 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:20.619471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307435e-b04d-4ee4-9d5e-3b7dd7cb1e99 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:20.619471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307435e-b04d-4ee4-9d5e-3b7dd7cb1e99 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:20.620766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 567/1154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:20.626011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505688-d84a-4720-8103-6319528c49cd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:20.626438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505688-d84a-4720-8103-6319528c49cd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:20.626536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505688-d84a-4720-8103-6319528c49cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:20.644123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c8505688-d84a-4720-8103-6319528c49cd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:20.645324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c8505688-d84a-4720-8103-6319528c49cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:20.707839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 588/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:20.973675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307435e-b04d-4ee4-9d5e-3b7dd7cb1e99 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:21.072922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307435e-b04d-4ee4-9d5e-3b7dd7cb1e99 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:21.105814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:21.106420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:21.106694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:21.106961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:21.117242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:11:21.121891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:21.123060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:11:21.124222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 568/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:21.128840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505688-d84a-4720-8103-6319528c49cd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:21.151903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:21.224644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505688-d84a-4720-8103-6319528c49cd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:21.257083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:21.257657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:21.257932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:21.258280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:21.258930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:21.259224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:21.260569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:21.268130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 589/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:21.274621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:21.284346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:21.371396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb7df-ccf1-4051-bee6-28e7eaea92ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:21.403287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:21.403895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:21.404173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:21.404442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] PATH_INFO: `/v3/users/a644a8dcccff4d8ea258e99acb6cd1b7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:21.405560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] RBAC: Authorizing `identity:get_user(user_id=a644a8dcccff4d8ea258e99acb6cd1b7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:21.406963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:21.408507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 569/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:21 2022] GET /identity/v3/users/a644a8dcccff4d8ea258e99acb6cd1b7 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:21.414843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:21.498308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:21.514825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad631-bc39-470a-93ab-f372dcc91505 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:21.547333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:21.547933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:21.548210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:21.548477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:21.612312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:21.613778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:21.691421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:21.708246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 590/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:11:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:11:21.714826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:21.786808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:21.811334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088ac7-2beb-401f-9a3a-118a1c577729 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:21.844636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33cc5b-ce29-4f7b-8701-2533d98cf243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:21.845270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33cc5b-ce29-4f7b-8701-2533d98cf243 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:21.845543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33cc5b-ce29-4f7b-8701-2533d98cf243 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:21.845807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33cc5b-ce29-4f7b-8701-2533d98cf243 None admin] PATH_INFO: `/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:21.846882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33cc5b-ce29-4f7b-8701-2533d98cf243 None admin] RBAC: Authorizing `identity:get_project(project_id=e43aa37e01a54ab28a01c558cc1e1ea5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:21.848282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33cc5b-ce29-4f7b-8701-2533d98cf243 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:21.849904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 570/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:21 2022] GET /identity/v3/projects/e43aa37e01a54ab28a01c558cc1e1ea5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:21.856022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:21.951106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b29c57-286e-4d8b-9913-39510b6d6899 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:21.983301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:21.983882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:21.984151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:21.984413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:21.985152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=e43aa37e01a54ab28a01c558cc1e1ea5, user.id=a644a8dcccff4d8ea258e99acb6cd1b7) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:21.985451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:21.986849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51ceb8-75a1-4614-94c1-86466c7c5293 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:21.992859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 591/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:11:21 2022] GET /identity/v3/role_assignments?user.id=a644a8dcccff4d8ea258e99acb6cd1b7&scope.project.id=e43aa37e01a54ab28a01c558cc1e1ea5&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:24.130913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c7f8-e1af-468a-996a-978076898753 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:24.131524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c7f8-e1af-468a-996a-978076898753 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:24.131524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c7f8-e1af-468a-996a-978076898753 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:24.133085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 571/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:24.138154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:24.138571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:24.138677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:24.156986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:24.158139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:24.199152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:24.222176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 592/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:24.492416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c7f8-e1af-468a-996a-978076898753 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:24.588687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c7f8-e1af-468a-996a-978076898753 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:24.621142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:24.621729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:24.622003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:24.622268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:24.633520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:24.685908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:24.687323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:24.781857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 572/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:11:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:11:24.788206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:24.884207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763387-3d26-4e7e-89f3-b02d948c4bdc None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:24.917230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:24.917840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:24.918113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:24.918378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:24.924739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:24.926199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-3cecbe6d-5f42-435a-8d3b-a8c9b1d10776 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:24.937428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:24.938623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:11:24.939493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 593/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:11:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:24.944559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:24.986588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:25.040905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ddda6-35b4-4e62-b092-2b173856f974 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:25.072638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:25.073258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:25.073539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:25.073811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:25.074451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:25.074752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:25.076098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35e912-2349-496b-ba11-d49b79b21104 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:25.083198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 573/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 28 12:11:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:27.207938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55a196-647a-455c-94d4-1097cdc28044 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:27.208489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55a196-647a-455c-94d4-1097cdc28044 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:27.208489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55a196-647a-455c-94d4-1097cdc28044 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:27.210356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 594/1167] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:27.215938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f03c1-0eda-4c4c-8935-2da0f76a378e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:27.216356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f03c1-0eda-4c4c-8935-2da0f76a378e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:27.216490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f03c1-0eda-4c4c-8935-2da0f76a378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:27.234869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-809f03c1-0eda-4c4c-8935-2da0f76a378e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:27.236041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-809f03c1-0eda-4c4c-8935-2da0f76a378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:27.300132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 574/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:27.573408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55a196-647a-455c-94d4-1097cdc28044 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:27.614427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:27.673649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55a196-647a-455c-94d4-1097cdc28044 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:27.706250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70ca9-1bfb-431b-b558-1bfd162d6139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:27.706831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70ca9-1bfb-431b-b558-1bfd162d6139 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:27.707105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70ca9-1bfb-431b-b558-1bfd162d6139 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:27.707373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70ca9-1bfb-431b-b558-1bfd162d6139 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:27.708035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c70ca9-1bfb-431b-b558-1bfd162d6139 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:27.709566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c70ca9-1bfb-431b-b558-1bfd162d6139 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:27.724698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 595/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Sep 28 12:11:27 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:11:29.858828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dcb53-63df-4c3e-b2f5-eb678ec06612 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:29.859342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dcb53-63df-4c3e-b2f5-eb678ec06612 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:29.859342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dcb53-63df-4c3e-b2f5-eb678ec06612 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:29.860695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 575/1170] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:29.866519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:29.866894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:29.867045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:29.884490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:29.885680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:29.949029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 596/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:30.215886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dcb53-63df-4c3e-b2f5-eb678ec06612 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:30.250531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:30.313052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dcb53-63df-4c3e-b2f5-eb678ec06612 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:30.345160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dda5c-66e9-47cb-8c56-08d2ba5dc989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:30.345768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dda5c-66e9-47cb-8c56-08d2ba5dc989 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:30.346044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dda5c-66e9-47cb-8c56-08d2ba5dc989 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:30.346309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dda5c-66e9-47cb-8c56-08d2ba5dc989 None admin] PATH_INFO: `/v3/domains/0b83a7642fe84a638f64d649f509b63a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:30.356756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dda5c-66e9-47cb-8c56-08d2ba5dc989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0b83a7642fe84a638f64d649f509b63a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:30.358196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dda5c-66e9-47cb-8c56-08d2ba5dc989 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:30.359746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 576/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Sep 28 12:11:30 2022] GET /identity/v3/domains/0b83a7642fe84a638f64d649f509b63a => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:30.365572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:30.391933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:30.462763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955b81-2be2-4560-b8b4-1d0b4c48d33e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:30.496017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510735b-199d-4072-8c7e-d332734c98fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:30.496552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510735b-199d-4072-8c7e-d332734c98fd None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:30.496890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510735b-199d-4072-8c7e-d332734c98fd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:30.497196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510735b-199d-4072-8c7e-d332734c98fd None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:30.497881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510735b-199d-4072-8c7e-d332734c98fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:30.499338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510735b-199d-4072-8c7e-d332734c98fd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:30.525644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 597/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:11:30 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:11:32.688238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615d2f7-3cc5-42f0-8e3e-584c1cc54129 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:32.688763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615d2f7-3cc5-42f0-8e3e-584c1cc54129 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:32.688763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615d2f7-3cc5-42f0-8e3e-584c1cc54129 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:32.690126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 577/1174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:32.695830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:32.696260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:32.696364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:32.714546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:32.715713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:32.779365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 598/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:11:33.049398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615d2f7-3cc5-42f0-8e3e-584c1cc54129 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:33.142365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:33.149842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615d2f7-3cc5-42f0-8e3e-584c1cc54129 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:33.182367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784da2b-63c7-4c2b-a6e8-435ae0fb2fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:33.182972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784da2b-63c7-4c2b-a6e8-435ae0fb2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:33.183243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784da2b-63c7-4c2b-a6e8-435ae0fb2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:33.183506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784da2b-63c7-4c2b-a6e8-435ae0fb2fa9 None admin] PATH_INFO: `/v3/domains/0b83a7642fe84a638f64d649f509b63a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:33.184578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784da2b-63c7-4c2b-a6e8-435ae0fb2fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0b83a7642fe84a638f64d649f509b63a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:33.186010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784da2b-63c7-4c2b-a6e8-435ae0fb2fa9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:33.187534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 578/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Sep 28 12:11:33 2022] GET /identity/v3/domains/0b83a7642fe84a638f64d649f509b63a => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:33.193283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:33.204800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:33.291223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df74472-b678-43e6-a5e6-0d1046c9284c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:33.323815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2f236-e1c3-4c6e-9a8b-9bac452db130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:33.324407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f236-e1c3-4c6e-9a8b-9bac452db130 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:33.324683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f236-e1c3-4c6e-9a8b-9bac452db130 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:33.324992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f236-e1c3-4c6e-9a8b-9bac452db130 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:33.325635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2f236-e1c3-4c6e-9a8b-9bac452db130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:33.327050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2f236-e1c3-4c6e-9a8b-9bac452db130 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:33.348525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 599/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:11:33 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:11:35.520453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc79096-a6de-4dce-9ccb-edac50812ede None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:35.521051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc79096-a6de-4dce-9ccb-edac50812ede None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:35.521051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc79096-a6de-4dce-9ccb-edac50812ede None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:35.522578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 579/1178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:35.528019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:35.528437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:35.528558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:35.546403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:35.547572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:35.605591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:35.613460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 600/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:35.892240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc79096-a6de-4dce-9ccb-edac50812ede None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:35.989423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc79096-a6de-4dce-9ccb-edac50812ede None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:36.021719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:36.022327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:36.022602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:36.022870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:36.032892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:11:36.038082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:36.039186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:11:36.040359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 580/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:36.045165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:36.139838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1204ae-6854-4314-853c-55ee4ad99b74 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:36.173066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:36.173648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:36.173917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:36.174181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:36.174838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:36.175132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:36.176478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:36.184332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 601/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:36.190105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:36.215317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:36.285932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8018060-1afc-4bac-8594-a823450b0bcc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:36.318410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:36.319259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:36.319536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:36.319804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] PATH_INFO: `/v3/users/d17374f7fed648448cfcf76a9e04e6e5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:36.332419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] RBAC: Authorizing `identity:get_user(user_id=d17374f7fed648448cfcf76a9e04e6e5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:36.334371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:36.336275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 581/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:36 2022] GET /identity/v3/users/d17374f7fed648448cfcf76a9e04e6e5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:36.341907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:36.398602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:36.438990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067dec-1499-4785-ab1e-e94ee78f6c94 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:36.471089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:36.471670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:36.471941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:36.472205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:36.536164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:36.537632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:36.596322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:36.637069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 602/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:11:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:11:36.643163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:36.721726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:36.738896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56afc-287a-45e1-9cf7-051b5e9c8140 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:36.773024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171387f-4510-44ec-b259-5850593f9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:36.773623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171387f-4510-44ec-b259-5850593f9184 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:36.773898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171387f-4510-44ec-b259-5850593f9184 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:36.774163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171387f-4510-44ec-b259-5850593f9184 None admin] PATH_INFO: `/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:36.775243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171387f-4510-44ec-b259-5850593f9184 None admin] RBAC: Authorizing `identity:get_project(project_id=46ed7785ce76450abbf0aff9fb2fc8ab)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:36.776647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171387f-4510-44ec-b259-5850593f9184 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:36.778254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 582/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:36 2022] GET /identity/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:36.784293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:36.882214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106234c-3004-4a32-a5e1-c558f66a3863 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:36.913916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:36.914505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:36.914777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:36.915045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:36.915761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=46ed7785ce76450abbf0aff9fb2fc8ab, user.id=d17374f7fed648448cfcf76a9e04e6e5) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:36.916064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:36.917510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e04c9-67a9-4f56-b71f-de44bcb9b58a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:36.922635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 603/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:11:36 2022] GET /identity/v3/role_assignments?user.id=d17374f7fed648448cfcf76a9e04e6e5&scope.project.id=46ed7785ce76450abbf0aff9fb2fc8ab&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:39.023058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f964-10c2-4069-8d39-bee785b6d618 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:39.023605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f964-10c2-4069-8d39-bee785b6d618 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:39.023605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49f964-10c2-4069-8d39-bee785b6d618 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:39.024977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 583/1186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:39.030122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:39.030512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:39.030678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:39.048475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:39.049658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:39.065444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:39.114324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 604/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:39.387468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f964-10c2-4069-8d39-bee785b6d618 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:39.484415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49f964-10c2-4069-8d39-bee785b6d618 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:39.516456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:39.517086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:39.517362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:39.517627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:39.527331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:11:39.532102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:39.533267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:11:39.534295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 584/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:11:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:39.539777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:39.635431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d527e5-9d2c-457f-8444-3125e3f5e94e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:39.667755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:39.668277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:39.668547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:39.668834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:39.669486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:39.669782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:39.671120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:39.679800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 605/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:39.685531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:39.697774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:39.781391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a772c5e-231c-444d-8bd2-e85ad46e84ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:39.815267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:39.815888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:39.816164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:39.816429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] PATH_INFO: `/v3/users/d17374f7fed648448cfcf76a9e04e6e5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:39.817560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] RBAC: Authorizing `identity:get_user(user_id=d17374f7fed648448cfcf76a9e04e6e5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:39.819122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:39.820686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 585/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:39 2022] GET /identity/v3/users/d17374f7fed648448cfcf76a9e04e6e5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:39.826404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:39.842715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:39.922772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14536b4-561f-4429-bd48-b2d1ceed502a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:39.954335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527aa31-d0f6-4588-a1f7-e0c1ed90bfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:39.954936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527aa31-d0f6-4588-a1f7-e0c1ed90bfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:39.955209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527aa31-d0f6-4588-a1f7-e0c1ed90bfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:39.955475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527aa31-d0f6-4588-a1f7-e0c1ed90bfa3 None admin] PATH_INFO: `/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:39.956570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527aa31-d0f6-4588-a1f7-e0c1ed90bfa3 None admin] RBAC: Authorizing `identity:get_project(project_id=46ed7785ce76450abbf0aff9fb2fc8ab)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:39.958010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527aa31-d0f6-4588-a1f7-e0c1ed90bfa3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:39.960146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 606/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:39 2022] GET /identity/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:39.966153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:40.041593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:40.062356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53359b-f5e0-4e5e-945d-9b24800ac911 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:40.094877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76a841-6875-405c-92a1-f796155e4026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:40.095515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a841-6875-405c-92a1-f796155e4026 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:40.095795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a841-6875-405c-92a1-f796155e4026 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:40.096064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76a841-6875-405c-92a1-f796155e4026 None admin] PATH_INFO: `/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab/users/d17374f7fed648448cfcf76a9e04e6e5/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:40.097960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76a841-6875-405c-92a1-f796155e4026 None admin] RBAC: Authorizing `identity:create_grant(project_id=46ed7785ce76450abbf0aff9fb2fc8ab, user_id=d17374f7fed648448cfcf76a9e04e6e5, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:40.099957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76a841-6875-405c-92a1-f796155e4026 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:40.112045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 586/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:11:39 2022] PUT /identity/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab/users/d17374f7fed648448cfcf76a9e04e6e5/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:11:42.238542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62087-7bb4-4026-b7bc-aa3f543d37d6 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:42.239092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62087-7bb4-4026-b7bc-aa3f543d37d6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:42.239092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62087-7bb4-4026-b7bc-aa3f543d37d6 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:42.241066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 607/1193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:11:42.246343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:42.246739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:42.246876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:42.264977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:11:42.266131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:11:42.328505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 587/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:11:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:11:42.598060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62087-7bb4-4026-b7bc-aa3f543d37d6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:42.678728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:42.697139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62087-7bb4-4026-b7bc-aa3f543d37d6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:42.729544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:42.730148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:42.730420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:42.730685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:42.740957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:11:42.745686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:11:42.746782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:11:42.747965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 608/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:11:42.752630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:42.816654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:42.851442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa49f1-9f46-4675-bc8d-c3ce2c098cff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:42.884111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:42.884699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:42.885002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:42.885267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:42.885911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:42.886202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:42.887535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:42.895095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 588/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:42.901577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:42.997398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65520546-ebe6-46f5-af21-dc93c02edaff None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:43.029440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:43.030061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:43.030339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:43.030609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] PATH_INFO: `/v3/users/d17374f7fed648448cfcf76a9e04e6e5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:43.031737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] RBAC: Authorizing `identity:get_user(user_id=d17374f7fed648448cfcf76a9e04e6e5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:43.033196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:43.034760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 609/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 28 12:11:42 2022] GET /identity/v3/users/d17374f7fed648448cfcf76a9e04e6e5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:43.041308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:43.136613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d40b1d-21be-4b15-a14e-20c2117e93e9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:43.164100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:43.170106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:43.170689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:43.170960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:43.171220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:43.236644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:43.238120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:43.331840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 589/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:11:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:11:43.338427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:43.350325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:43.433840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9c0c9-8c28-4812-8ebd-10c0c400d48b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:43.466972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049943cc-514a-48b8-8fe6-c192c0355b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:43.467579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049943cc-514a-48b8-8fe6-c192c0355b96 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:43.467874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049943cc-514a-48b8-8fe6-c192c0355b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:43.468141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049943cc-514a-48b8-8fe6-c192c0355b96 None admin] PATH_INFO: `/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:43.469268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049943cc-514a-48b8-8fe6-c192c0355b96 None admin] RBAC: Authorizing `identity:get_project(project_id=46ed7785ce76450abbf0aff9fb2fc8ab)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:43.470681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049943cc-514a-48b8-8fe6-c192c0355b96 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:43.472307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 610/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 28 12:11:43 2022] GET /identity/v3/projects/46ed7785ce76450abbf0aff9fb2fc8ab => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:43.478425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:11:43.507106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:43.575217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984d53-52cd-4e91-a7ba-702effeef62a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:11:43.607982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:11:43.608561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:11:43.608859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:11:43.609123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:11:43.609827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=46ed7785ce76450abbf0aff9fb2fc8ab, user.id=d17374f7fed648448cfcf76a9e04e6e5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:11:43.610123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:11:43.611507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cde5a-ad9d-4a37-864e-c1cfc9968fce None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:11:43.617757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 590/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:11:43 2022] GET /identity/v3/role_assignments?user.id=d17374f7fed648448cfcf76a9e04e6e5&scope.project.id=46ed7785ce76450abbf0aff9fb2fc8ab&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:11:53.462945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=61 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:11:53.614978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=53 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:39.548493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384d382-bdd8-4fe0-aa36-4c1d0208f434 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:39.549217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384d382-bdd8-4fe0-aa36-4c1d0208f434 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:39.549217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384d382-bdd8-4fe0-aa36-4c1d0208f434 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:39.550526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 611/1201] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:12:39.556005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:39.556499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:39.556587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:39.576200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:39.577428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:39.657967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 591/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:12:39.944878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384d382-bdd8-4fe0-aa36-4c1d0208f434 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:40.080910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384d382-bdd8-4fe0-aa36-4c1d0208f434 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:40.123626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:40.124367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:40.124700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:40.125123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:40.144087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:40.145905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:40.164708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:40.166249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:40.167211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:40.167211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:40.167211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:40.167211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 612/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:40.175248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:40.297467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58454-8886-43ee-9ad3-269d6b17b477 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:40.335447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:40.341475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:40.342087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:40.342366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:40.342635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:40.343284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:40.343584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:40.344973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c14536-d433-492a-a9fe-e62e6d8d5674 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:40.357733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 592/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:40.364261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:40.427697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:40.480797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60104a7-522d-4fc9-a402-6d77cf3a90de None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:40.522536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72fb3-379d-4fa1-9a56-af1c8c15ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:40.523261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72fb3-379d-4fa1-9a56-af1c8c15ac15 None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:40.523496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72fb3-379d-4fa1-9a56-af1c8c15ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:40.523750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72fb3-379d-4fa1-9a56-af1c8c15ac15 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:40.524445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72fb3-379d-4fa1-9a56-af1c8c15ac15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:40.526061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72fb3-379d-4fa1-9a56-af1c8c15ac15 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:40.553984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 613/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 28 12:12:40 2022] POST /identity/v3/users => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:12:42.836214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afebd0-a3e8-4727-bc15-5b1edde67aca None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:42.836757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afebd0-a3e8-4727-bc15-5b1edde67aca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:42.836757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afebd0-a3e8-4727-bc15-5b1edde67aca None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:42.838142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 593/1206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:12:42.843723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:42.844183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:42.844272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:42.863882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:42.865159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:42.941174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 614/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:12:43.213393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afebd0-a3e8-4727-bc15-5b1edde67aca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:43.333889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afebd0-a3e8-4727-bc15-5b1edde67aca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:43.374847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:43.375788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:43.376071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:43.376334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:43.387501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:12:43.392998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:43.394219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:43.397860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 594/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:12:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:43.403243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:43.450323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:43.529984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f62327-f13a-4b4a-b352-64552dcebd04 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:43.568406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:43.569058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:43.569379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:43.569664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:43.570409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:43.570716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:43.572239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:43.582523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 615/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:12:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:43.588628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:43.658569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:43.722818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c0ec-ad72-4c76-a9ec-a7ca0ebf20ad None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:43.763875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:43.764528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:43.764836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:43.765147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:43.780695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:43.782621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:43.801445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:43.802450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:43.803386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:43.803386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:43.803386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:43.803386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 595/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:43.809304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:43.929121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:43.931586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0faf55-d281-43f4-94af-75ebf918995f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:43.968139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:43.968742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:43.969063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:43.969327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:43.969980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:43.970818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:43.972255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:43.985664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 616/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:43.992197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:44.117190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b3ce-5af4-49af-bc7b-b673d6205f7b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:44.118826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:44.161537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:44.162580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:44.162580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:44.162817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:44.171803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:44.173990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:12:44.186743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:44.190410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:44.191382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 596/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:44.195057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:44.309494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235a0f1-8738-4a46-86d8-d446e0de7fb0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:44.349699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:44.350708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:44.351238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:44.351772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:44.352596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:44.352960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:44.354781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:44.374986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 617/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 28 12:12:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:44.381879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:44.499382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b16194-6c53-4631-b17f-3778492db2ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:44.539979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:44.540591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:44.540894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:44.541168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:44.585847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:44.645227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:44.646852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:44.760706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 597/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:12:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:12:44.767417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:44.787808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:44.884078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aebba-c0a7-498b-89ce-72e8548100c3 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:44.925015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:44.925564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:44.925840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:44.926130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:44.937071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:44.939896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:44.956999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:44.958273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:44.959427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:44.959427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:44.959427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:44.965662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 618/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:12:44.967341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:45.041246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:45.085187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bccc85-18e4-463c-b55d-c239cdba8920 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:45.124076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:45.124686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:45.124998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:45.125331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:45.126010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:45.126347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:45.128028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:45.140850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 598/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:45.147076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:45.223864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:45.258409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566516-9489-45c1-af5e-db7180c258e5 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:45.296888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:45.297586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:45.297961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:45.298171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:45.305979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:45.307432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:12:45.321060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:45.322048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:12:45.322957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:45.328998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 619/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:45.329138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:45.451563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5ec4b-c772-4537-b6a8-349d6727ef8b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:45.479256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:45.495458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:45.496387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:45.496690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:45.497047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:45.497763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:45.498066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:45.499578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70762-4623-435a-9ef3-5f2ce767e59c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:45.515817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 599/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:12:45.522679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:45.650520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5263d-cc80-4842-8c7f-4ad4bc145edf None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:45.687447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:45.696041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:45.696747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:45.697105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:45.697418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:45.698281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=5cb077a5cb994974a54ee83240ddb0b5) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:45.698568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:45.700196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14c520-c421-49d1-9da9-cbb31ca2c6a6 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:45.716821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 620/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:12:45 2022] GET /identity/v3/role_assignments?user.id=5cb077a5cb994974a54ee83240ddb0b5&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:48.050735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc9dc7-0ef4-445b-b6ef-59a9e998a856 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:48.051312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc9dc7-0ef4-445b-b6ef-59a9e998a856 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:48.051312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc9dc7-0ef4-445b-b6ef-59a9e998a856 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:48.052634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 600/1220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:12:48.057934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:48.058386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:48.058502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:48.076619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:48.078187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:48.153153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 621/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:12:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:12:48.444978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc9dc7-0ef4-445b-b6ef-59a9e998a856 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:48.559554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc9dc7-0ef4-445b-b6ef-59a9e998a856 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:48.597797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:48.598456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:48.598734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:48.599005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:48.611254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:12:48.617191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:48.618479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:48.619334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 601/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:12:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:48.624607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:48.742324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44571d60-3069-43a8-b8ad-e4a6d88d3e38 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:48.768734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:48.780101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:48.780695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:48.780990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:48.781254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:48.781902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:48.782196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:48.783854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:48.791779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 622/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:12:48.797593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:48.846715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:48.911727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d96d2-fae0-4888-81d2-839e9fbe7734 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:48.948961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:48.949674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:48.949929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:48.950195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:48.961776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:48.963424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:48.979689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:48.981117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:48.982231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:48.982231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:48.982231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:48.982231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 602/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:48.987839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:49.096004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cfe66-3a31-48b8-9d06-0c720c83be7a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:49.135157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:49.135767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:49.136044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:49.136316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:49.136989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:49.137292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:49.138870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:49.151871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 623/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:49.158806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:49.259569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:49.267264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf003a-9e88-42ce-b28b-69e48c26262a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:49.302146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:49.302763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:49.303035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:49.303296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:49.310669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:49.312083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:12:49.323627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:49.324856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:49.325941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 603/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:49.331861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:49.381107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:49.441255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000cbb8-ac54-4809-8be9-9a7c639ad0aa None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:49.480338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:49.480977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:49.481286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:49.481537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:49.482306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:49.482643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:49.484178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:49.505114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 624/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 28 12:12:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:49.511508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:49.619738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa2b60-baf5-4c2c-a5a5-7ab5a726d6c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:49.658754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:49.659373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:49.659677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:49.659942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:49.672372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:49.673946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:49.690653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:49.691862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:49.693013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:49.693013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:49.693013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:49.696714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 604/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:12:49.697947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:49.812432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e4127-edb7-4139-9d11-c5d107c136cd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:49.815444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:49.851823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:49.852432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:49.852710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:49.853027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:49.853667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:49.853948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:49.855311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:49.871780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 625/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:12:49.873015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:49.882600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:49.983733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc41a7b-8f7e-4961-b821-8217900cc596 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:50.019701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:50.020314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:50.020602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:50.020885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:50.029661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:50.031088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:12:50.043141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:50.044242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:50.045376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 605/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:50.050764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:50.168665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7b1e2-615d-4474-813c-d7e26f415648 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:50.206842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:50.207451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:50.207720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:50.207982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:50.208665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:50.208990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:50.210426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf7c4-c598-4b5e-a10d-9f4d1bf2643a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:50.224466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 626/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:50.230605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:50.300697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:50.339658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e2d0-1521-42c6-acd0-57cf09caa99d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:50.378858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7274c-1658-46b8-b92c-d49c547c739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:50.379530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7274c-1658-46b8-b92c-d49c547c739b None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:50.379810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7274c-1658-46b8-b92c-d49c547c739b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:50.380081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7274c-1658-46b8-b92c-d49c547c739b None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/5cb077a5cb994974a54ee83240ddb0b5/roles/5311369671e74fd6805944c0d2881a60` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:50.397256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7274c-1658-46b8-b92c-d49c547c739b None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=5cb077a5cb994974a54ee83240ddb0b5, role_id=5311369671e74fd6805944c0d2881a60)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:50.398695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7274c-1658-46b8-b92c-d49c547c739b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:50.414973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 606/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:12:50 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/5cb077a5cb994974a54ee83240ddb0b5/roles/5311369671e74fd6805944c0d2881a60 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:12:52.808324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6674ad-aed5-4441-8caf-253717a757ad None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:52.808810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6674ad-aed5-4441-8caf-253717a757ad None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:52.808918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6674ad-aed5-4441-8caf-253717a757ad None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:52.810230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 627/1233] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:12:52.816468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:52.816955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:52.817049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:52.837589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:52.838974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:52.912840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 607/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:12:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:12:53.221876 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6674ad-aed5-4441-8caf-253717a757ad None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:53.248937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:53.337422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6674ad-aed5-4441-8caf-253717a757ad None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:53.374824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:53.375677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:53.376564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:53.376958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:53.387687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:12:53.394404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:53.395470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:53.396311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 628/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 28 12:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:53.402831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:53.452672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:53.512319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57a546-aa20-48bb-b996-4ee210931a45 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:53.552288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:53.552934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:53.553215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:53.553495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:53.554140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:53.554440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:53.555795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:53.566423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 608/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 28 12:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:53.572492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:53.668490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:53.686225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e6169-32ee-48fe-9fa3-9296d7883514 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:53.723018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:53.723640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:53.723964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:53.724232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:53.734367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:53.736532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:53.752687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:53.753845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:53.754953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:53.754953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:53.754953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:53.756591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 629/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:53.762311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:53.871737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fadf3-a776-4952-9978-8d7b50b2f828 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:53.881541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:53.907073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:53.907710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:53.907982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:53.908243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:53.908897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:53.909191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:53.910560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:53.922268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 609/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:53.928887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:54.029595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907b3d-295e-4bad-9f7d-9b83b582d63c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:54.066042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:54.066673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:54.066947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:54.067212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:54.070075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:54.075327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:54.076950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:12:54.089141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:54.090279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:54.091226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 630/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:54.097455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:54.209362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59b5c-04ca-42e1-83fa-cb57049e80f1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:54.250058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:54.250676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:54.251777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:54.252375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:54.253318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:54.253757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:54.255823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:54.276729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 610/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 28 12:12:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:54.282678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:54.395568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13676d8-4043-4b54-9107-da80848eecc9 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:54.431852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:54.432749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:54.433043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:54.433310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:54.499764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:54.510974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:54.513510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:54.630725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 631/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:12:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 12:12:54.636981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:54.665788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:54.743660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e4784-1ca3-4b7c-95b6-5f5f15b1d309 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:54.779844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:54.780462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:54.780738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:54.781033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:54.792931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:54.794367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:54.813078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:54.818575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:54.819660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:54.819660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:54.819660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:54.819660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 611/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 12:12:54.820540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:54.931776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:54.937761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5821-8037-4804-9a9d-5dbd5de5750c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:54.977498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:54.978123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:54.978399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:54.978666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:54.979310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:54.979608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:54.980995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:54.992474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 632/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:54.998137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:55.082393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:55.104382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9a108-084f-4e72-9caa-234e4cf79a54 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:55.140207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:55.140858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:55.141134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:55.141415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:55.148550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:55.149997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:12:55.161877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:55.162998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:55.164177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 612/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:55.168765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:55.279759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf28ee-4736-4f7b-8fb4-91366ad49dd4 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:55.316690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:55.317335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:55.317641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:55.317920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:55.318686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:55.318989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:55.320530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298734a7-9e5d-4874-93eb-f0c7f11ab08c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:55.340000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 633/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:55.341159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:55.446638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757bef0-fe73-420c-8452-af768e9d7667 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:55.498293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:55.499327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:55.499968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:55.500335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:55.502871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] RBAC: Adding query filter params (role.id=5311369671e74fd6805944c0d2881a60, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=5cb077a5cb994974a54ee83240ddb0b5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:55.503435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:55.506318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81154e6e-36c0-466e-b7ef-79d64e61c4b0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:55.516862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 613/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:12:55 2022] GET /identity/v3/role_assignments?user.id=5cb077a5cb994974a54ee83240ddb0b5&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=5311369671e74fd6805944c0d2881a60 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:57.952346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01fb3c-f34a-4348-bb0f-2d500abf590d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:57.952998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01fb3c-f34a-4348-bb0f-2d500abf590d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:57.952998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01fb3c-f34a-4348-bb0f-2d500abf590d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:57.955294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 634/1247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:12:57.960944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:57.961418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:57.961519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:57.968411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:57.983823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:12:57.985298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:12:58.060705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 614/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:12:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:12:58.333009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01fb3c-f34a-4348-bb0f-2d500abf590d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:58.353722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:58.440206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01fb3c-f34a-4348-bb0f-2d500abf590d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:58.483370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:58.484193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:58.484597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:58.485122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:58.496329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:12:58.501631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:58.503126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:58.504350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 635/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:58.508683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:58.622175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c04ee-f3f5-4dcc-b14e-d5fc62931ef5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:58.652975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:58.658225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:58.658901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:58.659247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:58.659574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:58.660319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:58.660682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:58.662134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:58.670271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 615/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:58.676506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:58.760003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:58.785246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7a9c8-820a-4707-a9ec-9f43fd22005a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:58.823739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:58.824427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:58.824707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:58.825037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:58.835915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:58.837395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:58.852833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:58.853996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:58.855064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:58.855064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:58.855064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:58.855064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 636/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:58.860214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:58.969192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcbda7-e52d-45c3-b882-c425680e969c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:59.006437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:59.007064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:59.007330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:59.007595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:59.008235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:59.008534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:59.009968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:59.023646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 616/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:12:59.029883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:59.140285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35719a0e-9010-4fce-95a9-73ae5d89ad83 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:59.167632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:59.176541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:59.177216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:59.177489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:59.177756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:59.186297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:59.187763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:12:59.200948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:59.207438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:12:59.208636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 637/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:59.210195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:59.269721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:59.315700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb597f-ffc8-4f53-bfb3-d82d8567eb36 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:59.352033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:59.352651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:59.352957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:59.353226 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:59.353961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:12:59.354263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:59.355687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:59.375437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 617/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 28 12:12:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:12:59.381585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:59.488331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5bb37-6108-42e1-8428-daa8196b0f3b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:59.530206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:59.530744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:59.531018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:59.531285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:59.587375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:59.600229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:59.601702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:59.702389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 638/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:12:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:12:59.708625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:59.808066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00836-7b2d-44de-82a4-e8c83a6014b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:12:59.821139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:59.842348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:12:59.842957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:12:59.843229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:12:59.843492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:12:59.853645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:12:59.855053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:12:59.869611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:12:59.870706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:12:59.871848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:12:59.871848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:12:59.871848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:12:59.871848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 618/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:12:59.876926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:12:59.960293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:59.972043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb742e3-0a54-4075-971c-eb0252192eb8 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:00.005767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:00.006351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:00.006619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:00.006880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:00.007511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:00.007805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:00.009212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:00.020377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 639/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:00.026229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:00.122854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c9a0-d207-4742-a2e9-9d88b40b2ff1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:00.154147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:00.154755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:00.155032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:00.155300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:00.162281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:00.163698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:13:00.175066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:00.176095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:00.177191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 619/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:00.181937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:00.278022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373c389-3ab0-419b-88ba-3f0f6f5c39f0 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:00.310663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:00.311240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:00.311512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:00.311775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:00.312446 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:00.312741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:00.314639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f3f6-f7fb-49ee-8dad-5e25d81ebf75 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:00.325869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 640/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:00.332256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:00.358532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:00.436829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ac1c5-e11c-406d-a278-1352ac8f79c8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:00.470821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:00.471416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:00.471692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:00.471959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:00.472676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=5cb077a5cb994974a54ee83240ddb0b5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:00.473008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:00.474424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f06a-bbaf-47e6-ba43-5278a3f6fbbd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:00.480254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 620/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:13:00 2022] GET /identity/v3/role_assignments?user.id=5cb077a5cb994974a54ee83240ddb0b5&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:13:02.593507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5920c8-c41a-4cb4-a042-1e2258c4c3b8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:02.594043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5920c8-c41a-4cb4-a042-1e2258c4c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:02.594224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5920c8-c41a-4cb4-a042-1e2258c4c3b8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:02.595563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 641/1261] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:02.600560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:02.600966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:02.601133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:02.619482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:02.620650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:02.684330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 621/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:13:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:13:02.950683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5920c8-c41a-4cb4-a042-1e2258c4c3b8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:02.962138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:03.049257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5920c8-c41a-4cb4-a042-1e2258c4c3b8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.081310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.081915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.082184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.082445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.091943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:13:03.096811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:03.097919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:03.098799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 642/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:03.103752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.121259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:03.199418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb354-c1d7-41f1-8cd5-43de1beecc73 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.231923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.232454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.232732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.233026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.233677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:03.233974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:03.235617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:03.243221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 622/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:03.248838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.313379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:03.345341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37bf4-f72c-4431-99d0-5b0cb1291617 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.377631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.378230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.378502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.378768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.388264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:03.389722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:13:03.404239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:03.405356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:13:03.406460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:13:03.406460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:03.406460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:03.406460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 643/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:03.411310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.492633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:03.518154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e097f37-173e-4a93-899d-9f21124a04a9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.562458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.563736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.564160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.564568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.565397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:03.565695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:03.567046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:03.578786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 623/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:03.584590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.680678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573d3ea-bffa-4632-ad43-7036eddc0866 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.699499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:03.714040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.714648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.714918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.715179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.723211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:03.724627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:13:03.736206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:03.737343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:03.738430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 644/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:03.743290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.838494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b958c23-4513-42d8-b0b2-d859f5232571 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:03.871479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:03.872067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:03.872343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:03.872608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:03.873347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:03.873646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:03.875042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:03.883415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:03.891814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 624/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:03.897543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:03.993475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d8c7-66cd-4227-82e0-201129d91d8d None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:04.024782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:04.025403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.025677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.025942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.036642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:04.038144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:13:04.052362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:04.053524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:13:04.054483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:13:04.054483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:04.054483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:04.054483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 645/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:04.059172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:04.153909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e95b5-821f-4f84-8cc4-4c1fb095b187 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:04.186924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:04.187502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.188315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.188769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.189480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:04.189775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:04.191110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:04.201676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 625/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:04.208022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:04.238539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:04.304153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b43d90-4819-4aec-ba87-610424fbf44a None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:04.337147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:04.337749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.338021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.338286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.345274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:04.346686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:13:04.357485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:04.358390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:04.359491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 646/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:04.364418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:04.421091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:04.461825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ce4a-279b-438b-ba10-1aebe4313caa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:04.498317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:04.499025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.499383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.499774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.500797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:04.501304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:04.503407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64802275-7737-4c00-b139-c152f029f9f8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:04.517931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 626/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:04.523880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:04.612867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:04.621519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d12dac-d41b-4086-b5ef-b9d310d5560c None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:04.654115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22168be4-2b44-460a-8df6-6ed0062bb903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:04.654751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168be4-2b44-460a-8df6-6ed0062bb903 None admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:04.655027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168be4-2b44-460a-8df6-6ed0062bb903 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:04.655296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168be4-2b44-460a-8df6-6ed0062bb903 None admin] PATH_INFO: `/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/5cb077a5cb994974a54ee83240ddb0b5/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:04.657215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22168be4-2b44-460a-8df6-6ed0062bb903 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c3be15a2b6747e6a0e1d5a70183bae3, user_id=5cb077a5cb994974a54ee83240ddb0b5, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:04.658635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22168be4-2b44-460a-8df6-6ed0062bb903 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:04.670422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 647/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 28 12:13:04 2022] PUT /identity/v3/projects/2c3be15a2b6747e6a0e1d5a70183bae3/users/5cb077a5cb994974a54ee83240ddb0b5/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:13:06.966165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e440a-a18e-4801-84e9-c36bd57d0155 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:06.966719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e440a-a18e-4801-84e9-c36bd57d0155 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:06.966719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e440a-a18e-4801-84e9-c36bd57d0155 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:06.968037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 627/1274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:06.973832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:06.974226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:06.974380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:06.992816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:06.993993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:07.058038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 648/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:13:07.334457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e440a-a18e-4801-84e9-c36bd57d0155 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:07.432294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e440a-a18e-4801-84e9-c36bd57d0155 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:07.448818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:07.465645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:07.466256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:07.466532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:07.466800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:07.477008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 12:13:07.482326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:07.483339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:07.484493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 628/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 28 12:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:07.490715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:07.585958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:07.604238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fa9ec-9d1a-4595-a01e-5b6396ac8e5f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:07.637266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:07.637856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:07.638128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:07.638392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:07.639046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:07.639342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:07.641286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:07.648907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 649/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 28 12:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:07.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:07.751292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc521e-fc8d-4a69-ab98-ba07bcb1fe40 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:07.784223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:07.784852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:07.785130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:07.785397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:07.795060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:07.796481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:13:07.811169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:07.812339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:13:07.814051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:13:07.814051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:07.814051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:07.814051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 629/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:07.818801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:07.914628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb859b01-4829-4df5-bb0e-a73462e131cd None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:07.947498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:07.948077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:07.948347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:07.948610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:07.949264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:07.949559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:07.950957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:07.962965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 650/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:07.968533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:07.998536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:08.068174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7df532-8d60-421d-a12a-e257f2ca7893 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:08.101069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:08.101683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:08.101958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:08.102228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:08.109307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:08.110902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 12:13:08.121598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:08.122529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:08.123697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 630/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:13:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:08.128572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:08.132318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:08.225154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f35a0f-7f1e-4f5d-a623-f8026fae470b None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:08.257029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:08.257620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:08.257894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:08.258161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:08.258881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:08.259180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:08.260588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:08.277487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 651/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 28 12:13:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:08.283885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:08.371620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:08.381799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b6db9-f6ac-4e2f-bba5-c6c2e1d53023 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:08.414321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:08.414904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:08.415176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:08.415440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:08.479854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:08.481251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:08.566655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:08.576441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 631/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 28 12:13:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 12:13:08.583035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:08.641916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:08.678543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31b7e-92e4-485a-860b-fdb69a5b8abb None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:08.711115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:08.711723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:08.711999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:08.712270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:08.722581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:08.724000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 12:13:08.738334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:08.739361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 12:13:08.740258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 12:13:08.740258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 12:13:08.740258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:08.740258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 652/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:08.745124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:08.840866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02232bd-ed27-47e4-93b8-e28e073e6b01 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:08.873280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:08.873868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:08.874144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:08.874413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:08.875170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:08.875534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:08.876917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:08.887623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 632/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 28 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:08.893762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:08.990145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2c7c4-7e43-47dd-a671-f713025e6a55 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:09.002993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:09.023033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:09.023652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:09.023929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:09.024198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:09.030638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:09.032804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 12:13:09.044567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:09.045618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: ERROR keystone.server.flask.application Sep 28 12:13:09.046863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 653/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 28 12:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:09.051470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:09.100759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:09.149543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02087e0e-0638-4203-9eba-18ba671f7cc1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:09.181141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:09.181728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:09.182003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:09.182275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:09.182951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:09.183250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:09.184644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f534e6-a3cd-46e7-8920-a76266b10a52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:09.196620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 633/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 28 12:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:09.202839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:09.298618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d942-3b43-44e9-a0eb-80e2cb98d60f None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:09.331923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:09.332503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:09.332799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:09.333066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:09.333773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] RBAC: Adding query filter params (role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5, scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3, user.id=5cb077a5cb994974a54ee83240ddb0b5) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:09.334073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:09.335491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136a382-3159-4523-a776-b2e2b0487780 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:09.340974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 654/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 28 12:13:09 2022] GET /identity/v3/role_assignments?user.id=5cb077a5cb994974a54ee83240ddb0b5&scope.project.id=2c3be15a2b6747e6a0e1d5a70183bae3&role.id=50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:11.507442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7544e4-9382-4a31-8d9b-1075c979798f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:11.508000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7544e4-9382-4a31-8d9b-1075c979798f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:11.508000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7544e4-9382-4a31-8d9b-1075c979798f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:11.509524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 634/1288] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:11.516544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:11.517003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:11.517314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:11.535695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:11.536896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:11.566688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:11.603634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 655/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:13:11.871222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7544e4-9382-4a31-8d9b-1075c979798f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:11.969524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7544e4-9382-4a31-8d9b-1075c979798f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:11.979585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:12.003125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:12.003790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:12.004060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:12.004322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:12.004909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:12.006241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:12.014588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:12.015769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:12.016724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 635/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:13:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:12.021767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:12.119146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92dcb6-b6cc-4d8f-a70d-dad17e8d453b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:12.151437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:12.152031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:12.152305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:12.152573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:12.153224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:12.153526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:12.154919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287875e3-0df0-4f5d-8e08-ae9fdad4e016 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:12.160283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 656/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 28 12:13:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:12.166017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:12.263219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c397a-133d-4814-8165-3e83c15b23b3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:12.295207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:12.295783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:12.296056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:12.296321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:12.297635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:12.297929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:12.299258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711e2bc-9c61-41c8-9e28-877671bdb4fc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:12.303484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 636/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 28 12:13:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:13:14.421138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09aa3a-859a-44b1-9c65-754f931023f4 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:14.422379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09aa3a-859a-44b1-9c65-754f931023f4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:14.422379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09aa3a-859a-44b1-9c65-754f931023f4 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:14.423548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 657/1293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:14.428744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96cd2-15c2-47c0-922e-32277bc87468 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:14.429152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96cd2-15c2-47c0-922e-32277bc87468 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:14.429326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96cd2-15c2-47c0-922e-32277bc87468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:14.447046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fca96cd2-15c2-47c0-922e-32277bc87468 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:14.448215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fca96cd2-15c2-47c0-922e-32277bc87468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:14.477017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:14.515564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 637/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:13:14.785222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09aa3a-859a-44b1-9c65-754f931023f4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:14.815633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:14.884087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09aa3a-859a-44b1-9c65-754f931023f4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:14.918335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb4ff3-ee5e-4b0c-b191-1a60d0b9601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:14.918915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4ff3-ee5e-4b0c-b191-1a60d0b9601b None admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:14.919191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4ff3-ee5e-4b0c-b191-1a60d0b9601b None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:14.919459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4ff3-ee5e-4b0c-b191-1a60d0b9601b None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:14.920109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb4ff3-ee5e-4b0c-b191-1a60d0b9601b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:14.921532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb4ff3-ee5e-4b0c-b191-1a60d0b9601b None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:14.936024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 658/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 28 12:13:14 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:13:17.076130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c89a-9dc7-44f7-9c39-0ddfa8ad055f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:17.076943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c89a-9dc7-44f7-9c39-0ddfa8ad055f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:17.076943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c89a-9dc7-44f7-9c39-0ddfa8ad055f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:17.078299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 638/1296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:17.083530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:17.083908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:17.084062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:17.101955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:17.103112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:17.172738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 659/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:13:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 12:13:17.441719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c89a-9dc7-44f7-9c39-0ddfa8ad055f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:17.545761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c89a-9dc7-44f7-9c39-0ddfa8ad055f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:17.580010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:17.580619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:17.580930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:17.581201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:17.581772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:17.583128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:17.591601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:17.592825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:17.593789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 639/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:13:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:17.598976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:17.616807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:17.696499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fdb98-f041-4bc4-9238-0fef02b6d5e6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:17.730085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:17.730669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:17.730937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:17.731201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:17.731816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:17.732107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:17.733475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:17.739164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 660/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 28 12:13:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:17.745076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:17.775892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:17.843186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e08d-acf4-4250-9bee-0603f70ddb31 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:17.875649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:17.876244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:17.876522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:17.876810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:17.877502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] RBAC: Adding query filter params (interface=public, service_id=db19ba41aa4d4d8087464214d0b38784, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:17.877807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:17.879147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4254e-b576-4f66-b5e4-28088b55d7ae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:17.883969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 640/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 28 12:13:17 2022] GET /identity/v3/endpoints?service_id=db19ba41aa4d4d8087464214d0b38784&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:17.889606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:17.967909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:17.986484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad870f-642e-4171-8d5e-1ce6d1e95858 None admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:18.019445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb28fb-233a-477b-81c1-c7116e1836e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:18.020063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb28fb-233a-477b-81c1-c7116e1836e7 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:18.020336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb28fb-233a-477b-81c1-c7116e1836e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:18.020601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb28fb-233a-477b-81c1-c7116e1836e7 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:18.021274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb28fb-233a-477b-81c1-c7116e1836e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:18.022742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb28fb-233a-477b-81c1-c7116e1836e7 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:18.029454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 661/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 28 12:13:17 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:13:20.149450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f19e3-625c-4193-adeb-cafcc598fe45 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:20.149977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f19e3-625c-4193-adeb-cafcc598fe45 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:20.149977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f19e3-625c-4193-adeb-cafcc598fe45 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:20.151332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 641/1302] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:13:20.157148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:20.157532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:20.157686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:20.175686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:13:20.176893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:13:20.240579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 662/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:13:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 12:13:20.512007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f19e3-625c-4193-adeb-cafcc598fe45 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:20.603225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:20.610266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f19e3-625c-4193-adeb-cafcc598fe45 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:20.642133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:20.642735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:20.643007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:20.643271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:20.643829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:20.645210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 12:13:20.653611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 12:13:20.654758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 28 12:13:20.655921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 642/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 28 12:13:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 12:13:20.660614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:20.734989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:20.757838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a97781-284b-4e32-a9ed-54489bfbbae7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:20.789888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:20.790417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:20.790693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:20.790966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] PATH_INFO: `/v3/services` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:20.791588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:13:20.791888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:20.793291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9c00-84b5-46bd-9c48-e37056bde178 None admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:20.799057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 663/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 28 12:13:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:13:20.804688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:13:20.901387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d8778-82e6-4bd1-bd57-ed82ee78669a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:13:20.934536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccc806-eec0-410f-abb2-c858ae12d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:13:20.935120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc806-eec0-410f-abb2-c858ae12d4a6 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:13:20.935392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc806-eec0-410f-abb2-c858ae12d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:13:20.935654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccc806-eec0-410f-abb2-c858ae12d4a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:13:20.936305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccc806-eec0-410f-abb2-c858ae12d4a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:13:20.938520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccc806-eec0-410f-abb2-c858ae12d4a6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:13:20.957593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 643/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:13:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:13:30.795933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=30 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:30.952966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:24.984517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccbd3e-7895-49db-827a-19e0e30b1f39 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:24.985114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccbd3e-7895-49db-827a-19e0e30b1f39 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:24.985114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccbd3e-7895-49db-827a-19e0e30b1f39 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:24.991514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 664/1307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:24.997844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fb7d-7056-4bb5-aa98-514bf453a6d9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:24.998343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fb7d-7056-4bb5-aa98-514bf453a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:24.998427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fb7d-7056-4bb5-aa98-514bf453a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:25.112228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5497fb7d-7056-4bb5-aa98-514bf453a6d9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:25.113383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5497fb7d-7056-4bb5-aa98-514bf453a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:25.231299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 644/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:25.525350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c4894-fbc0-42e6-83b5-79fbb560a677 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:25.525626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c4894-fbc0-42e6-83b5-79fbb560a677 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:25.526079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c4894-fbc0-42e6-83b5-79fbb560a677 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:25.528518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 665/1309] 10.222.0.27 () {54 vars in 964 bytes} [Wed Sep 28 12:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:25.534652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec542-713f-4a33-8140-2865cbf240ab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:25.535174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec542-713f-4a33-8140-2865cbf240ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:25.535709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec542-713f-4a33-8140-2865cbf240ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:25.619292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e7dec542-713f-4a33-8140-2865cbf240ab None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:25.620627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7dec542-713f-4a33-8140-2865cbf240ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:25.643543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:25.703398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 645/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Sep 28 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:25.712311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c4894-fbc0-42e6-83b5-79fbb560a677 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:25.714137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-769c4894-fbc0-42e6-83b5-79fbb560a677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:25.836878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c4894-fbc0-42e6-83b5-79fbb560a677 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:25.925893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:25.926510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:25.926788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:25.927073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:25.928749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:25.988033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:26.046489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:26.047935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d999-6e71-4b32-943d-ff3cc02f7175 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:26.068483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 666/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:28.531538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14197fd-85ef-48ad-b314-c1eaf093feae None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:28.532058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14197fd-85ef-48ad-b314-c1eaf093feae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:28.532151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14197fd-85ef-48ad-b314-c1eaf093feae None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:28.533467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 646/1312] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:28.538949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1755-e0bc-4c33-9729-e3f3ee5471ee None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:28.539383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1755-e0bc-4c33-9729-e3f3ee5471ee None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:28.539510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1755-e0bc-4c33-9729-e3f3ee5471ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:28.613182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b92d1755-e0bc-4c33-9729-e3f3ee5471ee None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:28.614344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b92d1755-e0bc-4c33-9729-e3f3ee5471ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:28.718255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 667/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:29.013257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14197fd-85ef-48ad-b314-c1eaf093feae None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:29.014897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e14197fd-85ef-48ad-b314-c1eaf093feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:29.128959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14197fd-85ef-48ad-b314-c1eaf093feae None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:29.207854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:29.210581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:29.211583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:29.212184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:29.212845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:29.214521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:29.330894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:29.332339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6ce08-9f36-4af4-963a-2c5fe7fcd55d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:29.352567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 647/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:31.831266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1194c-6f20-49e3-a780-5830c089693b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:31.831737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1194c-6f20-49e3-a780-5830c089693b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:31.831840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1194c-6f20-49e3-a780-5830c089693b None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:31.833187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 668/1315] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:31.838206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7181d-718e-46bd-9b2c-cd554b97a5d5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:31.838590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7181d-718e-46bd-9b2c-cd554b97a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:31.838740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7181d-718e-46bd-9b2c-cd554b97a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:31.905258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aec7181d-718e-46bd-9b2c-cd554b97a5d5 None None] MFA Rules not processed for user `98bbfc1dec994eac983e7237ae779d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:31.906454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aec7181d-718e-46bd-9b2c-cd554b97a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:31.957036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:32.002208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 648/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:32.302521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d67de-3d04-42f7-b848-0f68611d8a67 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:32.302800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d67de-3d04-42f7-b848-0f68611d8a67 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:32.303071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d67de-3d04-42f7-b848-0f68611d8a67 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:32.304410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 669/1317] 10.222.0.27 () {54 vars in 964 bytes} [Wed Sep 28 12:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:32.310624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306020d3-4126-4e7d-add1-4bcdf93fbf8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:32.310914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306020d3-4126-4e7d-add1-4bcdf93fbf8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:32.311187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306020d3-4126-4e7d-add1-4bcdf93fbf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:32.385614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-306020d3-4126-4e7d-add1-4bcdf93fbf8c None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:32.387399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-306020d3-4126-4e7d-add1-4bcdf93fbf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:32.460169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 649/1318] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Sep 28 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:32.469362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d67de-3d04-42f7-b848-0f68611d8a67 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:32.470902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-891d67de-3d04-42f7-b848-0f68611d8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:32.481057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:32.573715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d67de-3d04-42f7-b848-0f68611d8a67 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:32.645492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:32.646118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:32.646399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:32.646664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:32.648280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:32.710138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:32.756587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:32.758053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e86ec6-334d-4a82-9883-4733806d34f8 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:32.775243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 670/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:35.822226 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c429e4-b645-4dfa-939a-3236e49164cb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:35.822709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c429e4-b645-4dfa-939a-3236e49164cb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:35.822798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c429e4-b645-4dfa-939a-3236e49164cb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:35.824404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 650/1320] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:35.829558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a11b-1577-4d7f-b3e3-58f52ab94620 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:35.829989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a11b-1577-4d7f-b3e3-58f52ab94620 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:35.830085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a11b-1577-4d7f-b3e3-58f52ab94620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:35.894995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7387a11b-1577-4d7f-b3e3-58f52ab94620 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:35.896201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7387a11b-1577-4d7f-b3e3-58f52ab94620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:35.991169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 671/1321] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:36.275390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c429e4-b645-4dfa-939a-3236e49164cb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:36.277044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86c429e4-b645-4dfa-939a-3236e49164cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:36.327245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:36.378889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c429e4-b645-4dfa-939a-3236e49164cb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:36.449563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:36.450151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:36.450426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:36.450696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:36.452248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:36.552487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:36.566030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:36.567445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2343-fcff-4c7d-a1b4-54280daad9b7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:36.585105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 651/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:39.451052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd46f-e44d-4c87-a97b-3ef93b36c7de None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:39.451611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd46f-e44d-4c87-a97b-3ef93b36c7de None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:39.451611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd46f-e44d-4c87-a97b-3ef93b36c7de None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:39.452972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 672/1323] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:14:39.458353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d515a7-6b23-4c8b-8b81-4887371913fa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:39.458795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d515a7-6b23-4c8b-8b81-4887371913fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:39.458907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d515a7-6b23-4c8b-8b81-4887371913fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:39.534822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c2d515a7-6b23-4c8b-8b81-4887371913fa None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:39.536080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c2d515a7-6b23-4c8b-8b81-4887371913fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:39.639127 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 652/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:39.926724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd46f-e44d-4c87-a97b-3ef93b36c7de None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:39.928316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-81efd46f-e44d-4c87-a97b-3ef93b36c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:39.949266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:40.033200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd46f-e44d-4c87-a97b-3ef93b36c7de None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:40.107792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:40.108503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:40.108797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:40.109071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:40.110693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:40.184576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:40.223563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:40.225033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe71e8-a994-4380-a961-0742326611b8 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:40.243678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 673/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:42.458479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37129f-bff2-47b8-b029-0e15fc1a7af4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:42.459031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37129f-bff2-47b8-b029-0e15fc1a7af4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:42.459031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37129f-bff2-47b8-b029-0e15fc1a7af4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:42.460358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 653/1326] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:42.465953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec2a78-5227-4a6b-b1ee-0760cad1a5b3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:42.466391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec2a78-5227-4a6b-b1ee-0760cad1a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:42.466503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec2a78-5227-4a6b-b1ee-0760cad1a5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:42.533358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f5ec2a78-5227-4a6b-b1ee-0760cad1a5b3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:42.534493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f5ec2a78-5227-4a6b-b1ee-0760cad1a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:42.640497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 674/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:42.925797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37129f-bff2-47b8-b029-0e15fc1a7af4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:42.927430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a37129f-bff2-47b8-b029-0e15fc1a7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:42.987578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:43.032960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37129f-bff2-47b8-b029-0e15fc1a7af4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:43.111546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:43.112163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:43.112442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:43.112712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:43.114318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:43.220621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:43.223186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:43.224794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4c0ec-c0ae-4518-bf43-9faf22a0f0c2 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:43.243250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 654/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:45.472493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016990b-00a8-4ab9-9845-d66ac895013f None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:45.473021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016990b-00a8-4ab9-9845-d66ac895013f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:45.473021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016990b-00a8-4ab9-9845-d66ac895013f None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:45.474365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 675/1329] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:45.479741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07000a7-0ac0-44fb-ab78-8047ee4c9bd6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:45.480173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07000a7-0ac0-44fb-ab78-8047ee4c9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:45.480302 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07000a7-0ac0-44fb-ab78-8047ee4c9bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:45.548912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a07000a7-0ac0-44fb-ab78-8047ee4c9bd6 None None] MFA Rules not processed for user `98bbfc1dec994eac983e7237ae779d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:45.549997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a07000a7-0ac0-44fb-ab78-8047ee4c9bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:45.645226 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 655/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:45.929397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016990b-00a8-4ab9-9845-d66ac895013f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:45.930929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1016990b-00a8-4ab9-9845-d66ac895013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:45.963204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:46.035665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016990b-00a8-4ab9-9845-d66ac895013f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:46.110136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:46.110736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:46.111010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:46.111277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:46.112882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:46.191366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:46.223845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:46.225245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa13a6-49af-4304-8ab2-568f4d8555d9 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:46.243964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 676/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:48.643348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec42f7-538c-42ea-90cd-09f74bd2b2a3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.643867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec42f7-538c-42ea-90cd-09f74bd2b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.643867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec42f7-538c-42ea-90cd-09f74bd2b2a3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.645599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 656/1332] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:14:48.651959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ebd5b-18a2-4ef2-86ab-e20b30a552d1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:48.652707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ebd5b-18a2-4ef2-86ab-e20b30a552d1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:48.652707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ebd5b-18a2-4ef2-86ab-e20b30a552d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:48.719249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-671ebd5b-18a2-4ef2-86ab-e20b30a552d1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:48.720462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-671ebd5b-18a2-4ef2-86ab-e20b30a552d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:48.814964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 677/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:14:49.099905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec42f7-538c-42ea-90cd-09f74bd2b2a3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:49.101461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02ec42f7-538c-42ea-90cd-09f74bd2b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:49.171017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.205573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec42f7-538c-42ea-90cd-09f74bd2b2a3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:49.277536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:49.278134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:49.278407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:49.278669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:49.280238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:49.384938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:49.386601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8b36e-7498-43dc-8d4c-0e51deca08ac service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:49.396252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.405081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 657/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:51.593380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1667-e116-4fbd-9638-dbefaf326eaa None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.593951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1667-e116-4fbd-9638-dbefaf326eaa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.593951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1667-e116-4fbd-9638-dbefaf326eaa None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.595257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 678/1335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:51.600646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ff57c-93a9-4e5b-a402-91d65758b915 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:51.601111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ff57c-93a9-4e5b-a402-91d65758b915 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:51.601235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ff57c-93a9-4e5b-a402-91d65758b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:51.666223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b3ff57c-93a9-4e5b-a402-91d65758b915 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:51.667587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b3ff57c-93a9-4e5b-a402-91d65758b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:51.763833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 658/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:52.049803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1667-e116-4fbd-9638-dbefaf326eaa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:52.051347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-22db1667-e116-4fbd-9638-dbefaf326eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:52.091206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:52.153234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1667-e116-4fbd-9638-dbefaf326eaa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:52.225270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:52.225868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:52.226143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:52.226410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:52.227986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:52.310050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:52.336069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:52.337519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf4211-f079-4218-b643-34b5d4212243 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:52.355601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 679/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:54.816270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033214-c5fa-4a83-be56-d003a41ca2b3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.816695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033214-c5fa-4a83-be56-d003a41ca2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.816828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033214-c5fa-4a83-be56-d003a41ca2b3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.818173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 659/1338] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:54.824084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18338849-1a6b-4e9f-ba04-8602e2bea583 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:54.824506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18338849-1a6b-4e9f-ba04-8602e2bea583 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:54.824598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18338849-1a6b-4e9f-ba04-8602e2bea583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:54.889540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-18338849-1a6b-4e9f-ba04-8602e2bea583 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:54.890723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-18338849-1a6b-4e9f-ba04-8602e2bea583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:54.985321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 680/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:14:55.264573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033214-c5fa-4a83-be56-d003a41ca2b3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:14:55.266160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e033214-c5fa-4a83-be56-d003a41ca2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:55.343150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:55.371285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033214-c5fa-4a83-be56-d003a41ca2b3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:14:55.442817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:14:55.443415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:55.443693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:55.443963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:55.445577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:55.553095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:14:55.554428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491e48f-78d4-4e03-a281-8f67de9ecf2c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:14:55.571997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 660/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:14:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:14:59.646784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04200a1-ebd8-4093-b893-cb6b7d9fbbfe None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.647259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04200a1-ebd8-4093-b893-cb6b7d9fbbfe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.647359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04200a1-ebd8-4093-b893-cb6b7d9fbbfe None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.648815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 681/1341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:14:59.654799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2415-b08f-464f-83c0-9d5e4e804d84 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:14:59.655242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2415-b08f-464f-83c0-9d5e4e804d84 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:14:59.655421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f2415-b08f-464f-83c0-9d5e4e804d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:14:59.660978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:59.729966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fd7f2415-b08f-464f-83c0-9d5e4e804d84 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:14:59.731296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd7f2415-b08f-464f-83c0-9d5e4e804d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:14:59.841216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 661/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:00.127369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04200a1-ebd8-4093-b893-cb6b7d9fbbfe None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:00.128941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c04200a1-ebd8-4093-b893-cb6b7d9fbbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:00.177039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:00.232374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04200a1-ebd8-4093-b893-cb6b7d9fbbfe None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:00.307069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:00.307669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:00.307945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:00.308214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:00.309849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:00.403320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:00.420150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:00.421614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa85daa-8afa-4c3c-b4c7-78330ad13448 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:00.443089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 682/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:03.272249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4db9-ffa9-45bd-924c-50e7f45cc273 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.272843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4db9-ffa9-45bd-924c-50e7f45cc273 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.272965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4db9-ffa9-45bd-924c-50e7f45cc273 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.274687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 662/1344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:03.283147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428d7a-d3f2-476f-b07c-f65bb6065741 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.283659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428d7a-d3f2-476f-b07c-f65bb6065741 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.283659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428d7a-d3f2-476f-b07c-f65bb6065741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.350342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9c428d7a-d3f2-476f-b07c-f65bb6065741 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:03.351549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c428d7a-d3f2-476f-b07c-f65bb6065741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.456843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 683/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:03.754168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4db9-ffa9-45bd-924c-50e7f45cc273 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:03.755772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-170a4db9-ffa9-45bd-924c-50e7f45cc273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:03.851157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:03.868167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4db9-ffa9-45bd-924c-50e7f45cc273 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:03.945188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:03.945710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:03.945987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:03.946261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:03.948047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:04.060557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:04.062016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115b1d4-7385-4340-a346-e7a27e5e58d8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:04.080389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 663/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:08.326581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9565e-16ce-44a3-840f-c805da55a77a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.327140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9565e-16ce-44a3-840f-c805da55a77a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.327140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9565e-16ce-44a3-840f-c805da55a77a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.328475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 684/1347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:08.335342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0454a3-e2f0-4064-a2e9-6629373b03b4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:08.335810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0454a3-e2f0-4064-a2e9-6629373b03b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:08.336243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0454a3-e2f0-4064-a2e9-6629373b03b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:08.357047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:08.414410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ea0454a3-e2f0-4064-a2e9-6629373b03b4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:08.415828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ea0454a3-e2f0-4064-a2e9-6629373b03b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:08.521657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 664/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:08.833567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9565e-16ce-44a3-840f-c805da55a77a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:08.836005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2fd9565e-16ce-44a3-840f-c805da55a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:08.909309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:08.957045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9565e-16ce-44a3-840f-c805da55a77a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:09.043517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:09.044152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:09.044428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:09.044728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:09.046449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:09.158468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:09.163270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:09.164738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273c89f-118b-43c6-a438-6e159961a460 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:09.185893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 685/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:14.108202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fae18-2d7e-4e66-b540-1ac890100b81 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.109121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fae18-2d7e-4e66-b540-1ac890100b81 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.109625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fae18-2d7e-4e66-b540-1ac890100b81 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.111987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 665/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:14.118620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152124f-4afb-4a4b-ad5f-5542e34a9794 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:14.119041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152124f-4afb-4a4b-ad5f-5542e34a9794 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:14.119329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152124f-4afb-4a4b-ad5f-5542e34a9794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:14.213878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f152124f-4afb-4a4b-ad5f-5542e34a9794 None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:14.215097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f152124f-4afb-4a4b-ad5f-5542e34a9794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:14.391798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 686/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:15:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:18.519483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=59 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:18.598625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43fc1-2cae-4fdd-95d1-be2dbe9b0450 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.598971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43fc1-2cae-4fdd-95d1-be2dbe9b0450 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.599199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43fc1-2cae-4fdd-95d1-be2dbe9b0450 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.600791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 666/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:18.606364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c820b9e-e24d-407f-bdbf-b691fddeef15 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:18.606809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c820b9e-e24d-407f-bdbf-b691fddeef15 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:18.606907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c820b9e-e24d-407f-bdbf-b691fddeef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:18.662707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:18.688641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5c820b9e-e24d-407f-bdbf-b691fddeef15 None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:18.689857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c820b9e-e24d-407f-bdbf-b691fddeef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:18.813186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 687/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:20.273476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1fad-c4c9-4a53-a486-b18c70da9cd2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:20.274239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1fad-c4c9-4a53-a486-b18c70da9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:20.274239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1fad-c4c9-4a53-a486-b18c70da9cd2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:20.275464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 667/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:20.280546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc1658-390d-4842-aa99-a1be43e0710b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:20.280986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc1658-390d-4842-aa99-a1be43e0710b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:20.281338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc1658-390d-4842-aa99-a1be43e0710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:20.361754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1dfc1658-390d-4842-aa99-a1be43e0710b None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:20.362958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1dfc1658-390d-4842-aa99-a1be43e0710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:20.406953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:20.472032 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 688/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:24.074208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b103-7e5e-4062-a2b9-7d46866bd99d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:24.074738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b103-7e5e-4062-a2b9-7d46866bd99d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:24.074738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b103-7e5e-4062-a2b9-7d46866bd99d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:24.075974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 668/1356] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:24.081235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dede733-b3e5-4bd1-a181-847656352180 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:24.081623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dede733-b3e5-4bd1-a181-847656352180 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:24.081778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dede733-b3e5-4bd1-a181-847656352180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:24.155824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7dede733-b3e5-4bd1-a181-847656352180 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:24.157031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7dede733-b3e5-4bd1-a181-847656352180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:24.261628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 689/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:24.576125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c148a6-1583-4cbe-aafa-56e5fc3e1b0d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:24.576752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c148a6-1583-4cbe-aafa-56e5fc3e1b0d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:24.577570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c148a6-1583-4cbe-aafa-56e5fc3e1b0d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:24.580125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 669/1358] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 28 12:15:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:24.587181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ee06-d1dc-4982-bdcb-f0c023b457ce None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:24.587461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ee06-d1dc-4982-bdcb-f0c023b457ce None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:24.587723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ee06-d1dc-4982-bdcb-f0c023b457ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:24.605290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:24.674288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-eaa0ee06-d1dc-4982-bdcb-f0c023b457ce None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:24.675516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eaa0ee06-d1dc-4982-bdcb-f0c023b457ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:24.809806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 690/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 28 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:24.817827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c148a6-1583-4cbe-aafa-56e5fc3e1b0d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:24.819707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-46c148a6-1583-4cbe-aafa-56e5fc3e1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:24.975129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c148a6-1583-4cbe-aafa-56e5fc3e1b0d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:25.052228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:25.094812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:25.095456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:25.095716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:25.095932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:25.097512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:25.197985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:25.199539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1bcd4-39b2-4f25-8662-35847e2ff8d5 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:25.219348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 670/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:27.633512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f786-6a94-4ae0-bf3f-effd45720279 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:27.633512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f786-6a94-4ae0-bf3f-effd45720279 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:27.634317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f786-6a94-4ae0-bf3f-effd45720279 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:27.637434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 691/1361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:27.641171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2738a-dc99-4a62-b552-ad6606a19c2e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:27.641778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2738a-dc99-4a62-b552-ad6606a19c2e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:27.641778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2738a-dc99-4a62-b552-ad6606a19c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:27.709591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76c2738a-dc99-4a62-b552-ad6606a19c2e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:27.711387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76c2738a-dc99-4a62-b552-ad6606a19c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:27.749897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:27.812306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 671/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:28.101649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f786-6a94-4ae0-bf3f-effd45720279 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:28.103180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-63d0f786-6a94-4ae0-bf3f-effd45720279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:28.176928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.280427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f786-6a94-4ae0-bf3f-effd45720279 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:28.425239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:28.425871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:28.426147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:28.426417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:28.428022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:28.451836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.525291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:28.526916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73182e28-ccd4-4410-beb9-ea73f6617020 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:28.545942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 692/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:31.056693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c0ec-d628-4fb6-a386-d17bb5dcb5ff None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.057291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c0ec-d628-4fb6-a386-d17bb5dcb5ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.057291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c0ec-d628-4fb6-a386-d17bb5dcb5ff None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.058499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 672/1364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:31.063899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb58f-c641-48f9-8461-e41e24d4fe77 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.064342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb58f-c641-48f9-8461-e41e24d4fe77 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.064431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb58f-c641-48f9-8461-e41e24d4fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.133962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dffcb58f-c641-48f9-8461-e41e24d4fe77 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:31.135213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dffcb58f-c641-48f9-8461-e41e24d4fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.249012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:31.260999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 693/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:31.550817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a32b8-8db2-4eda-9e42-8246672eb9ef None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.551124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a32b8-8db2-4eda-9e42-8246672eb9ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.551395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a32b8-8db2-4eda-9e42-8246672eb9ef None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.552862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 673/1366] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 28 12:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:31.558794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727121-3c0a-43c3-a4c4-b41fb384b244 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:31.559192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727121-3c0a-43c3-a4c4-b41fb384b244 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:31.559565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727121-3c0a-43c3-a4c4-b41fb384b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:31.639729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-04727121-3c0a-43c3-a4c4-b41fb384b244 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:31.641202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-04727121-3c0a-43c3-a4c4-b41fb384b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.771923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 694/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 28 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:31.776241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a32b8-8db2-4eda-9e42-8246672eb9ef None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:31.777901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f97a32b8-8db2-4eda-9e42-8246672eb9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:31.954530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a32b8-8db2-4eda-9e42-8246672eb9ef None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:31.976912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:32.079265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:32.079942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.080195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.080404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.082021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:32.181183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:32.182789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74f26-916b-48d1-b32d-b4e4c1769986 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:32.202108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 674/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:32.266988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754c7bf-b1a0-4303-9e73-f898344db280 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.267526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754c7bf-b1a0-4303-9e73-f898344db280 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.267526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754c7bf-b1a0-4303-9e73-f898344db280 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.272768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 695/1369] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:32.274695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8259d4-1452-4253-9968-908b93e324cd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.275079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8259d4-1452-4253-9968-908b93e324cd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.275452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8259d4-1452-4253-9968-908b93e324cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.321079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:32.358731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2f8259d4-1452-4253-9968-908b93e324cd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:32.359967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f8259d4-1452-4253-9968-908b93e324cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:32.480296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 675/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:32.822934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362468fc-ed02-4a00-92dd-7fca49ef8a06 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.823219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362468fc-ed02-4a00-92dd-7fca49ef8a06 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.823494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362468fc-ed02-4a00-92dd-7fca49ef8a06 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.824896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 696/1371] 10.222.0.27 () {54 vars in 963 bytes} [Wed Sep 28 12:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:32.830171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006552-6c74-4c88-9d67-acdffdb70ba9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:32.830579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006552-6c74-4c88-9d67-acdffdb70ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:32.830951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006552-6c74-4c88-9d67-acdffdb70ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:32.915953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f8006552-6c74-4c88-9d67-acdffdb70ba9 None None] MFA Rules not processed for user `f68ebccd64bc49d8a6c6d05d50ce2b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:32.917674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f8006552-6c74-4c88-9d67-acdffdb70ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:32.970055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:33.008639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 676/1372] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Sep 28 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:33.017212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362468fc-ed02-4a00-92dd-7fca49ef8a06 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:33.018951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-362468fc-ed02-4a00-92dd-7fca49ef8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.077765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:33.138107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362468fc-ed02-4a00-92dd-7fca49ef8a06 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:33.228758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:33.229401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:33.229682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:33.229958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:33.232033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:33.374298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:33.393293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:33.395094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f9248-c11c-43b0-8050-b18266d8dd2c service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:33.418568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 697/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:34.470068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7306e-3a18-44b2-879a-27e564614721 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:34.470576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7306e-3a18-44b2-879a-27e564614721 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:34.470576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7306e-3a18-44b2-879a-27e564614721 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:34.471933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 677/1374] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:34.477839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c03bd-a17f-406d-b236-c213488a21e4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:34.478339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c03bd-a17f-406d-b236-c213488a21e4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:34.478437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c03bd-a17f-406d-b236-c213488a21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:34.547059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b23c03bd-a17f-406d-b236-c213488a21e4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:34.548254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b23c03bd-a17f-406d-b236-c213488a21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:34.643563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 698/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:34.935100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7306e-3a18-44b2-879a-27e564614721 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:34.936675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3d7306e-3a18-44b2-879a-27e564614721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:35.106088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7306e-3a18-44b2-879a-27e564614721 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:35.161695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:35.225885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:35.226483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:35.226763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:35.227035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:35.228621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:35.320941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:35.322798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968b540-be39-4963-8fd5-1e2472eba26c service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:35.341304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 678/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:37.592329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9f06-c992-466c-88ef-ecd3e18f2300 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.592933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9f06-c992-466c-88ef-ecd3e18f2300 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.592933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9f06-c992-466c-88ef-ecd3e18f2300 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.594363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 699/1377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:37.599504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a849a53-2e0f-4694-845b-cf72f256e89d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:37.599951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a849a53-2e0f-4694-845b-cf72f256e89d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:37.600050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a849a53-2e0f-4694-845b-cf72f256e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:37.669649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4a849a53-2e0f-4694-845b-cf72f256e89d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:37.670836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a849a53-2e0f-4694-845b-cf72f256e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:37.677929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:37.775798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 679/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:38.069799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9f06-c992-466c-88ef-ecd3e18f2300 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:38.071745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c82c9f06-c992-466c-88ef-ecd3e18f2300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.135808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:38.226528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9f06-c992-466c-88ef-ecd3e18f2300 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:38.345699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:38.346210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:38.346481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:38.346744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:38.348314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:38.368489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:38.444503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:38.446422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bc194-b23f-4bc6-b7dc-da619d05bf93 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:38.465556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 700/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:40.711630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5de373-5fd1-43f8-8131-21ce4d069396 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.712187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5de373-5fd1-43f8-8131-21ce4d069396 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.712284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5de373-5fd1-43f8-8131-21ce4d069396 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.713828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 680/1380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:40.719130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a5ea-0682-42bf-b14c-6392f713e371 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:40.719573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a5ea-0682-42bf-b14c-6392f713e371 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:40.719681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20a5ea-0682-42bf-b14c-6392f713e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:40.788807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5d20a5ea-0682-42bf-b14c-6392f713e371 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:40.790151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5d20a5ea-0682-42bf-b14c-6392f713e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:40.899339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:40.905836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 701/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:41.201891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5de373-5fd1-43f8-8131-21ce4d069396 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:41.203608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4e5de373-5fd1-43f8-8131-21ce4d069396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.349025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:41.359482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5de373-5fd1-43f8-8131-21ce4d069396 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:41.474560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:41.475167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:41.475485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:41.475813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:41.477451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:41.576532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:41.578305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39abc9-5c53-4ab3-a512-e4dabc322620 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:41.589062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:41.598442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 681/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:43.826492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab453ea-30b3-42f7-9bb2-325ce30c3345 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.827021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab453ea-30b3-42f7-9bb2-325ce30c3345 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.827021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab453ea-30b3-42f7-9bb2-325ce30c3345 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.828376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 702/1383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:43.834518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a51b-46d7-4de8-8aa8-b02e051232da None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:43.834963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a51b-46d7-4de8-8aa8-b02e051232da None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:43.835367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a51b-46d7-4de8-8aa8-b02e051232da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:43.907638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f194a51b-46d7-4de8-8aa8-b02e051232da None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:43.908755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f194a51b-46d7-4de8-8aa8-b02e051232da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.018389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 682/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:44.312754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab453ea-30b3-42f7-9bb2-325ce30c3345 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:44.314539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3ab453ea-30b3-42f7-9bb2-325ce30c3345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.472502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab453ea-30b3-42f7-9bb2-325ce30c3345 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:44.543556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:44.596769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:44.597790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:44.598142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:44.598483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:44.600258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:44.702454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:44.704064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0fdcc-2ec2-40ec-b852-db8e98626f47 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:44.721865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 703/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:47.194688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2325c-251c-44aa-aa4d-74e068e926c1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.195246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2325c-251c-44aa-aa4d-74e068e926c1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.195246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2325c-251c-44aa-aa4d-74e068e926c1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.196485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 683/1386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:47.202642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3d86-644b-4d21-9ff6-b0117c4c9926 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.203148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3d86-644b-4d21-9ff6-b0117c4c9926 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.203284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3d86-644b-4d21-9ff6-b0117c4c9926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.278945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-deda3d86-644b-4d21-9ff6-b0117c4c9926 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:47.280478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-deda3d86-644b-4d21-9ff6-b0117c4c9926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.319565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:47.391146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 704/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:47.722140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2325c-251c-44aa-aa4d-74e068e926c1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:47.723756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2f2325c-251c-44aa-aa4d-74e068e926c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:47.802528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:47.874041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2325c-251c-44aa-aa4d-74e068e926c1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:47.986963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:47.987538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:47.987873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:47.988149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:47.990058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:48.033254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:48.086265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:48.087861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e8416-3b81-42f3-ba96-f471232210be service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:48.105774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 684/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:50.757737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744a74-024b-4d87-8623-615366add0e1 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.758282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744a74-024b-4d87-8623-615366add0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.758415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89744a74-024b-4d87-8623-615366add0e1 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.760111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 705/1389] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:15:50.766396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7252b-d5c0-4a73-a96a-7a8d358c09ce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:50.766863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7252b-d5c0-4a73-a96a-7a8d358c09ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:50.766971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7252b-d5c0-4a73-a96a-7a8d358c09ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:50.841584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1fb7252b-d5c0-4a73-a96a-7a8d358c09ce None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:50.842805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1fb7252b-d5c0-4a73-a96a-7a8d358c09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:50.949268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 685/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:51.304513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744a74-024b-4d87-8623-615366add0e1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:51.306127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-89744a74-024b-4d87-8623-615366add0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:51.462510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89744a74-024b-4d87-8623-615366add0e1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:51.480324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:51.581552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:51.582154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:51.582460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:51.582729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:51.584405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:51.679345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:51.681028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb417-521a-469d-93b9-04d337cb9b51 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:51.701091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 706/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:53.666736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d2c6-2955-4270-8049-b2c3cb41427c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.668651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d2c6-2955-4270-8049-b2c3cb41427c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.668651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d2c6-2955-4270-8049-b2c3cb41427c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.668955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 686/1392] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:53.674140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d2ff-e0fa-4f46-89a9-b93c43b1990d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.674610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d2ff-e0fa-4f46-89a9-b93c43b1990d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.674715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d2ff-e0fa-4f46-89a9-b93c43b1990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.701516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:53.744035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5c28d2ff-e0fa-4f46-89a9-b93c43b1990d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:53.745273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c28d2ff-e0fa-4f46-89a9-b93c43b1990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:53.853109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 707/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:53.926180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e933-5062-48aa-ae9c-a9634a9462fd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.926389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e933-5062-48aa-ae9c-a9634a9462fd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.926637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e933-5062-48aa-ae9c-a9634a9462fd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:53.928725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 687/1394] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:53.934107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f072f1-6bb3-4351-bd59-e193d7d77851 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:53.934392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f072f1-6bb3-4351-bd59-e193d7d77851 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:53.934667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f072f1-6bb3-4351-bd59-e193d7d77851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.002143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-32f072f1-6bb3-4351-bd59-e193d7d77851 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:54.003326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-32f072f1-6bb3-4351-bd59-e193d7d77851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.058422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.107341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 708/1395] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:54.161236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840ff1-9c10-43a9-a31e-d296b3bc78f6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.161586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840ff1-9c10-43a9-a31e-d296b3bc78f6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.161943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44840ff1-9c10-43a9-a31e-d296b3bc78f6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.163917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 688/1396] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 28 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:54.169239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.169523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.169793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.250632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] MFA Rules not processed for user `83cabf530a454894816fbc457fa9a808`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:54.251743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.338438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840ff1-9c10-43a9-a31e-d296b3bc78f6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.340281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-44840ff1-9c10-43a9-a31e-d296b3bc78f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.340994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 709/1397] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:54.356860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.406298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:54.407657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.451333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44840ff1-9c10-43a9-a31e-d296b3bc78f6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.457666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.530538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.531096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.531374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.531639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.533262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.534209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6db77-93b3-4ef8-b2d3-13e1b0d230e2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:54.605000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.647630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.647866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:54.648317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:54.648594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:54.648897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:54.649081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507af65-6d39-484e-a15a-949729beaa28 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.650496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:54.667023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 689/1398] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:15:54.691983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:54.743573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:54.745180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c316e0-e7af-4c6d-9985-f73d1b54150c service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:54.763208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 710/1399] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:15:55.422906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951a970-0352-4e2e-8ab0-830e8817b896 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.423257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951a970-0352-4e2e-8ab0-830e8817b896 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.423624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951a970-0352-4e2e-8ab0-830e8817b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.491891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3951a970-0352-4e2e-8ab0-830e8817b896 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:55.493530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3951a970-0352-4e2e-8ab0-830e8817b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.583718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 690/1400] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:55.630565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee89c-f0c4-4357-8d35-c5991f57083a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.631552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee89c-f0c4-4357-8d35-c5991f57083a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.631886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee89c-f0c4-4357-8d35-c5991f57083a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.633386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 711/1401] 10.222.0.27 () {54 vars in 943 bytes} [Wed Sep 28 12:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:55.639549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc31fd-27ae-46ad-a64a-8cc5cdbca152 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:55.639910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc31fd-27ae-46ad-a64a-8cc5cdbca152 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:55.640185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc31fd-27ae-46ad-a64a-8cc5cdbca152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:55.681269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:55.720576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1ccc31fd-27ae-46ad-a64a-8cc5cdbca152 None None] MFA Rules not processed for user `8f582fce261d42b185ad05f699cf1f00`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:55.721873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ccc31fd-27ae-46ad-a64a-8cc5cdbca152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.829873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 691/1402] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Sep 28 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:55.839702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee89c-f0c4-4357-8d35-c5991f57083a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:55.841271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dd7ee89c-f0c4-4357-8d35-c5991f57083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:55.980026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee89c-f0c4-4357-8d35-c5991f57083a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:56.007331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:56.086043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:56.086643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:56.086914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:56.087181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:56.088806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:56.173021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:56.174631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca65b73-45bb-454b-b53e-5bf1e1b486ad service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:56.183238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 712/1403] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:15:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:15:57.033338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b5826-5a57-4549-9a36-c159205757af None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.034390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b5826-5a57-4549-9a36-c159205757af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.034738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b5826-5a57-4549-9a36-c159205757af None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.036237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 692/1404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:15:57.042112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588a21-47f5-4ca6-aba4-9a51b62c630e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.042550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588a21-47f5-4ca6-aba4-9a51b62c630e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.042648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588a21-47f5-4ca6-aba4-9a51b62c630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.117144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-05588a21-47f5-4ca6-aba4-9a51b62c630e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:15:57.118269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-05588a21-47f5-4ca6-aba4-9a51b62c630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:57.128174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.226743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 713/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:15:57.516871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b5826-5a57-4549-9a36-c159205757af None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:15:57.518527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d0b5826-5a57-4549-9a36-c159205757af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:57.620676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.688905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b5826-5a57-4549-9a36-c159205757af None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:15:57.824934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:15:57.825537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:15:57.825814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:15:57.826074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:15:57.827651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:15:57.898187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.938855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:15:57.940420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14a74-484d-4a80-9c96-00b55d69f04e service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:15:57.959947 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 693/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:00.214309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748276-208e-4c9b-8593-99ce9188109a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.214879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748276-208e-4c9b-8593-99ce9188109a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.214879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748276-208e-4c9b-8593-99ce9188109a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.216108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 714/1407] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:00.221240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a488-856b-46b9-b8af-dc21be2577ce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:00.221656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a488-856b-46b9-b8af-dc21be2577ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:00.221841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a488-856b-46b9-b8af-dc21be2577ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:00.306566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8a79a488-856b-46b9-b8af-dc21be2577ce None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:00.307803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a79a488-856b-46b9-b8af-dc21be2577ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:00.421218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 694/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:00.717445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748276-208e-4c9b-8593-99ce9188109a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:00.719200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a8748276-208e-4c9b-8593-99ce9188109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:00.876241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:00.884076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748276-208e-4c9b-8593-99ce9188109a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:01.011161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:01.011775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:01.012177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:01.012439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:01.014107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:01.117669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:01.119243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ab67e-3fea-406a-b35d-6e884283538d service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:01.134803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:01.148951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 715/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:10.419456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:11.140918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:19.000840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253969-cbbf-4253-ac57-f55a639461e2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:19.001395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253969-cbbf-4253-ac57-f55a639461e2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:19.001504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253969-cbbf-4253-ac57-f55a639461e2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:19.002840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 695/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 28 12:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:19.008520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3ecc-3fe0-4fc1-a892-726727b64963 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:19.008995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3ecc-3fe0-4fc1-a892-726727b64963 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:19.009102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3ecc-3fe0-4fc1-a892-726727b64963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:19.087679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3a5c3ecc-3fe0-4fc1-a892-726727b64963 None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:19.088912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3a5c3ecc-3fe0-4fc1-a892-726727b64963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:19.194654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 716/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 28 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:19.209528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606ed43-a2b3-470d-8723-eb01f310a867 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:19.209795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606ed43-a2b3-470d-8723-eb01f310a867 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:19.210061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606ed43-a2b3-470d-8723-eb01f310a867 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:19.211380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 696/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 28 12:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:19.216022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9921e-5e2c-49ad-bd4a-5bea88c3fdb0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:19.216301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9921e-5e2c-49ad-bd4a-5bea88c3fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:19.216572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9921e-5e2c-49ad-bd4a-5bea88c3fdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:19.291552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:19.294382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e6e9921e-5e2c-49ad-bd4a-5bea88c3fdb0 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:19.296190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e6e9921e-5e2c-49ad-bd4a-5bea88c3fdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:19.418210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 717/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 28 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:22.021354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99a1f-9e8b-4bdc-a8e2-e8c4460c09d1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:22.022455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99a1f-9e8b-4bdc-a8e2-e8c4460c09d1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:22.022455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99a1f-9e8b-4bdc-a8e2-e8c4460c09d1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:22.024000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:22.029617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd53e8-0fb5-4909-ab38-edbf8d155b8a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:22.030037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd53e8-0fb5-4909-ab38-edbf8d155b8a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:22.030161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd53e8-0fb5-4909-ab38-edbf8d155b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:22.097171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-86cd53e8-0fb5-4909-ab38-edbf8d155b8a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:22.098376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-86cd53e8-0fb5-4909-ab38-edbf8d155b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:22.153191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:22.195551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:22.488053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99a1f-9e8b-4bdc-a8e2-e8c4460c09d1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:22.489937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bea99a1f-9e8b-4bdc-a8e2-e8c4460c09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:22.635095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99a1f-9e8b-4bdc-a8e2-e8c4460c09d1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:22.707245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:22.747297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:22.747831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:22.748105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:22.748371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:22.750671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:22.841330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:22.842919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0e08f-3e30-472c-9dba-327d8fcb04ce service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:22.862314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 698/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:24.016601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1165-a844-4f63-8888-65ef17a52d6b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:24.017188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1165-a844-4f63-8888-65ef17a52d6b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:24.017188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1165-a844-4f63-8888-65ef17a52d6b None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:24.018664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:24.025928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1235c-170c-443e-ba91-07742c3ce756 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:24.026431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1235c-170c-443e-ba91-07742c3ce756 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:24.026523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1235c-170c-443e-ba91-07742c3ce756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:24.102434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0cd1235c-170c-443e-ba91-07742c3ce756 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:24.103619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0cd1235c-170c-443e-ba91-07742c3ce756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:24.130146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:24.199750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:24.349720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1165-a844-4f63-8888-65ef17a52d6b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:24.351523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c76f1165-a844-4f63-8888-65ef17a52d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:24.496255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1165-a844-4f63-8888-65ef17a52d6b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:24.536256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:24.609476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:24.610070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:24.610343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:24.610609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:24.612176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:24.705243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:24.706827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee6ebf-1a2d-49a3-b15d-a440029d95a1 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:24.724170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 720/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:25.859558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988538e-f368-446b-9292-10978401c56e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:25.860035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988538e-f368-446b-9292-10978401c56e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:25.860153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988538e-f368-446b-9292-10978401c56e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:25.861469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:25.868632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e71a4-abe4-474f-9876-9c865652c052 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:25.869120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e71a4-abe4-474f-9876-9c865652c052 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:25.869216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e71a4-abe4-474f-9876-9c865652c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:25.924150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:25.946818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-192e71a4-abe4-474f-9876-9c865652c052 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:25.948053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-192e71a4-abe4-474f-9876-9c865652c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:26.044382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:16:26.196126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988538e-f368-446b-9292-10978401c56e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:26.197604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1988538e-f368-446b-9292-10978401c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:26.341800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988538e-f368-446b-9292-10978401c56e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:26.353894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:26.455714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:26.456236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:26.456512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:26.456800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:26.458394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:26.545975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:26.547553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110f603-411a-422d-b0bd-5de8dc42a555 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:26.565608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 701/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:27.693279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5dbd-fe7a-4dad-b52e-49b326c75253 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:27.694371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5dbd-fe7a-4dad-b52e-49b326c75253 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:27.694371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5dbd-fe7a-4dad-b52e-49b326c75253 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:27.695712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:27.702199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560bda-7387-4120-8264-49ebf37ec577 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:27.702625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560bda-7387-4120-8264-49ebf37ec577 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:27.702743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560bda-7387-4120-8264-49ebf37ec577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:27.722697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:27.778255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c4560bda-7387-4120-8264-49ebf37ec577 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:27.779462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4560bda-7387-4120-8264-49ebf37ec577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:27.876042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:28.027786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f5dbd-fe7a-4dad-b52e-49b326c75253 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:28.029271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2e4f5dbd-fe7a-4dad-b52e-49b326c75253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:28.139625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:28.174809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f5dbd-fe7a-4dad-b52e-49b326c75253 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:28.287504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:28.288751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:28.289063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:28.289332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:28.290946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:28.368028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:28.382224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:28.383808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f640d4e-a11c-403c-8aa1-55bafab7fdca service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:28.402068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 723/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:29.514246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04929df-92c0-4366-9e83-392aaa2a92e4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:29.514815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04929df-92c0-4366-9e83-392aaa2a92e4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:29.514815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04929df-92c0-4366-9e83-392aaa2a92e4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:29.516128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:29.522629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e5524-46cc-4403-a9bf-15739a060d20 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:29.523272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e5524-46cc-4403-a9bf-15739a060d20 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:29.523272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e5524-46cc-4403-a9bf-15739a060d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:29.598586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-de9e5524-46cc-4403-a9bf-15739a060d20 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:29.599780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-de9e5524-46cc-4403-a9bf-15739a060d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:29.695410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:29.849186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04929df-92c0-4366-9e83-392aaa2a92e4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:29.850729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a04929df-92c0-4366-9e83-392aaa2a92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:29.935163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:29.997030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04929df-92c0-4366-9e83-392aaa2a92e4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:30.111353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:30.111955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:30.112252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:30.112516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:30.114119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:30.161780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:30.203565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:30.205186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61eeb-e599-48cc-8860-eddaa6d8d894 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:30.222648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 704/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:31.294549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3920e7-9d13-4559-a131-efbedb75b392 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:31.295135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3920e7-9d13-4559-a131-efbedb75b392 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:31.295135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3920e7-9d13-4559-a131-efbedb75b392 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:31.296635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:31.302812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b58409-bb6d-410a-92a4-2f9e02696900 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:31.303313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b58409-bb6d-410a-92a4-2f9e02696900 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:31.303480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b58409-bb6d-410a-92a4-2f9e02696900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:31.378751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-14b58409-bb6d-410a-92a4-2f9e02696900 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:31.379960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14b58409-bb6d-410a-92a4-2f9e02696900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:31.474520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:31.626551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3920e7-9d13-4559-a131-efbedb75b392 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:31.628225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bc3920e7-9d13-4559-a131-efbedb75b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:31.675970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:31.771735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3920e7-9d13-4559-a131-efbedb75b392 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:31.885611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:31.886131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:31.886404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:31.886670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:31.888261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:31.895085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:31.977366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:31.978979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f33d7-f557-4fa8-8a8f-136e551785c2 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:31.997524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 726/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:33.071315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481427a-fe14-46bf-b3e3-83d1539613b9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:33.071854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481427a-fe14-46bf-b3e3-83d1539613b9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:33.071854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481427a-fe14-46bf-b3e3-83d1539613b9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:33.073126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:33.079489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c68b7-3786-40d6-aa57-21face58d473 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:33.079951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c68b7-3786-40d6-aa57-21face58d473 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:33.080068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c68b7-3786-40d6-aa57-21face58d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:33.156104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c03c68b7-3786-40d6-aa57-21face58d473 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:33.157567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c03c68b7-3786-40d6-aa57-21face58d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:33.225078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:33.254613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:33.406666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481427a-fe14-46bf-b3e3-83d1539613b9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:33.408087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8481427a-fe14-46bf-b3e3-83d1539613b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:33.425575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:33.555540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481427a-fe14-46bf-b3e3-83d1539613b9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:33.641778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:33.668085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:33.668600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:33.668906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:33.669176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:33.670763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:33.758904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:33.760480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873f92a-4f5c-4c2c-87f5-73bc57b3f86f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:33.778409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 707/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:34.865396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724262d-f55e-41b7-8b5b-fdc3bd91ec5a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:34.865975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724262d-f55e-41b7-8b5b-fdc3bd91ec5a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:34.865975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724262d-f55e-41b7-8b5b-fdc3bd91ec5a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:34.867293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:34.873534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c41778-4233-401e-acc6-77bb13aec3e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:34.874006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c41778-4233-401e-acc6-77bb13aec3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:34.874114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c41778-4233-401e-acc6-77bb13aec3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:34.949464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a2c41778-4233-401e-acc6-77bb13aec3e1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:34.950655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a2c41778-4233-401e-acc6-77bb13aec3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:34.991573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:35.045346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:35.196798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724262d-f55e-41b7-8b5b-fdc3bd91ec5a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:35.198318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6724262d-f55e-41b7-8b5b-fdc3bd91ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:35.343089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724262d-f55e-41b7-8b5b-fdc3bd91ec5a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:35.398087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:35.573540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:35.574388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:35.574659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:35.574939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:35.576496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:35.663328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:35.664921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ad5ad-66bb-4b0a-8dc1-6d730f8f9d06 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:35.682910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 729/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:36.738850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd521-9516-4261-a5fd-10059d706096 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:36.739413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd521-9516-4261-a5fd-10059d706096 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:36.739413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd521-9516-4261-a5fd-10059d706096 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:36.740800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:36.747206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20075e-6de9-40a9-b991-1562515521f9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:36.747654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20075e-6de9-40a9-b991-1562515521f9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:36.747751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20075e-6de9-40a9-b991-1562515521f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:36.825558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9d20075e-6de9-40a9-b991-1562515521f9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:36.826698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9d20075e-6de9-40a9-b991-1562515521f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:36.828691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:36.923959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:37.075429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cd521-9516-4261-a5fd-10059d706096 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:37.077028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f2cd521-9516-4261-a5fd-10059d706096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:37.222118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cd521-9516-4261-a5fd-10059d706096 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:37.249689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:37.333901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:37.334427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:37.334829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:37.335088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:37.336665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:37.423591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:37.425197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04a803-6522-45d4-ad36-a501064b759e service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:37.443249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 710/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:39.495615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bec32-9e2e-48a0-9d3e-d6c567f051bb None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:39.496183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bec32-9e2e-48a0-9d3e-d6c567f051bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:39.496183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bec32-9e2e-48a0-9d3e-d6c567f051bb None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:39.498234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:39.506014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebf16f-e404-4526-9238-a9d313c60ab5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:39.507021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebf16f-e404-4526-9238-a9d313c60ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:39.507471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebf16f-e404-4526-9238-a9d313c60ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:39.548151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:39.573889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cfebf16f-e404-4526-9238-a9d313c60ab5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:39.575394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cfebf16f-e404-4526-9238-a9d313c60ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:39.672554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:39.963047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bec32-9e2e-48a0-9d3e-d6c567f051bb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:39.964570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b97bec32-9e2e-48a0-9d3e-d6c567f051bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:40.067123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bec32-9e2e-48a0-9d3e-d6c567f051bb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:40.101372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:40.143214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:40.143798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:40.144065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:40.144325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:40.145913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:40.253993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:40.255413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83947-f954-43ac-b21d-a33895684bb5 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:40.273721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 732/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:42.641191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bec5-1c30-4932-91ce-d9b536568114 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.641729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bec5-1c30-4932-91ce-d9b536568114 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.641729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bec5-1c30-4932-91ce-d9b536568114 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.643089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:42.648942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17953ef6-0083-47af-af60-5daa273ac160 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:42.649370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17953ef6-0083-47af-af60-5daa273ac160 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:42.649511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17953ef6-0083-47af-af60-5daa273ac160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:42.714549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-17953ef6-0083-47af-af60-5daa273ac160 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:42.715740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-17953ef6-0083-47af-af60-5daa273ac160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:42.728111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:42.810695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:43.098699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6bec5-1c30-4932-91ce-d9b536568114 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:43.100303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d3e6bec5-1c30-4932-91ce-d9b536568114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:43.202382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6bec5-1c30-4932-91ce-d9b536568114 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:43.215290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:43.277447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:43.278070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:43.278342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:43.278605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:43.280172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:43.386152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:43.387469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9442e-f960-4440-a467-87ef3c278039 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:43.405696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 713/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:45.906805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c5e0-d34d-44ed-a206-aa94303a8263 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:45.907361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c5e0-d34d-44ed-a206-aa94303a8263 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:45.907361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c5e0-d34d-44ed-a206-aa94303a8263 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:45.908690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:45.914108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600ff0-2cb7-4cd1-adcb-a09c4610293f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:45.914537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600ff0-2cb7-4cd1-adcb-a09c4610293f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:45.914647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600ff0-2cb7-4cd1-adcb-a09c4610293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:45.963138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:45.981375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76600ff0-2cb7-4cd1-adcb-a09c4610293f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:45.982563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76600ff0-2cb7-4cd1-adcb-a09c4610293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:46.077631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:46.362928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c5e0-d34d-44ed-a206-aa94303a8263 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:46.364468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a5c1c5e0-d34d-44ed-a206-aa94303a8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:46.467869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c5e0-d34d-44ed-a206-aa94303a8263 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:46.510532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:46.545329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:46.545924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:46.546195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:46.546457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:46.548033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:46.655151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:46.656513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366d35-3d4f-4dfb-a36e-595b9cebc39d service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:46.674420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 735/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:48.954711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873d96-ae94-49c2-9506-2c9d1147457a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:48.955236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873d96-ae94-49c2-9506-2c9d1147457a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:48.955236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873d96-ae94-49c2-9506-2c9d1147457a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:48.956554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:48.962116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324cab-9aa6-493a-918f-930f052b1d4d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:48.962551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324cab-9aa6-493a-918f-930f052b1d4d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:48.962663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324cab-9aa6-493a-918f-930f052b1d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:49.028625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-08324cab-9aa6-493a-918f-930f052b1d4d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:49.029837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-08324cab-9aa6-493a-918f-930f052b1d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:49.054199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:49.128677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:49.421718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873d96-ae94-49c2-9506-2c9d1147457a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:49.423236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-90873d96-ae94-49c2-9506-2c9d1147457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:49.525594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873d96-ae94-49c2-9506-2c9d1147457a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:49.546117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:49.600212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:49.601575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:49.601850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:49.602115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:49.603699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:49.723552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:49.726385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa684be-d405-48bf-8b21-26539c022efb service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:49.745601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 716/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:51.961924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970dbf-0f17-48cb-a60d-0f91469646fd None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:51.962491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970dbf-0f17-48cb-a60d-0f91469646fd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:51.962491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970dbf-0f17-48cb-a60d-0f91469646fd None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:51.963796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:51.969219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0d5f9-7233-4e47-a7f4-ed1922e105ed None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:51.969617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0d5f9-7233-4e47-a7f4-ed1922e105ed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:51.969772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0d5f9-7233-4e47-a7f4-ed1922e105ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:52.032579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:52.035461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f2f0d5f9-7233-4e47-a7f4-ed1922e105ed None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:52.037256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f2f0d5f9-7233-4e47-a7f4-ed1922e105ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:52.134140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:52.420235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970dbf-0f17-48cb-a60d-0f91469646fd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:52.421807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7c970dbf-0f17-48cb-a60d-0f91469646fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:52.525197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970dbf-0f17-48cb-a60d-0f91469646fd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:52.576256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:52.602396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:52.602987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:52.603259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:52.603521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:52.605119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:52.714082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:52.715420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f623d-2615-4e8b-afdb-2969d278519c service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:52.733460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 738/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:54.961506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996db83-39f2-485e-8586-0fed6675db58 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.962033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996db83-39f2-485e-8586-0fed6675db58 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.962033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996db83-39f2-485e-8586-0fed6675db58 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:54.963317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:54.968700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e2ad-de51-420d-8fa6-1c8d8f75d102 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:54.969211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e2ad-de51-420d-8fa6-1c8d8f75d102 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:54.969314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e2ad-de51-420d-8fa6-1c8d8f75d102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:55.034833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ead5e2ad-de51-420d-8fa6-1c8d8f75d102 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:55.036023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ead5e2ad-de51-420d-8fa6-1c8d8f75d102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:55.064834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:55.132248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:55.421540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996db83-39f2-485e-8586-0fed6675db58 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:55.423062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c996db83-39f2-485e-8586-0fed6675db58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:55.525332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996db83-39f2-485e-8586-0fed6675db58 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:55.553171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:55.598388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:55.598918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:55.599192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:55.599458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:55.601233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:55.711518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:55.712969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c40913-41c1-4aa3-961c-1a714a50947d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:55.730607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 719/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:16:57.972095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d26c-aa6d-44cf-b84f-333719a7959d None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:57.972700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d26c-aa6d-44cf-b84f-333719a7959d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:57.972700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11d26c-aa6d-44cf-b84f-333719a7959d None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:57.974001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:16:57.979900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a3bb-5490-45f9-ba75-3927e8a31f69 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:57.980343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a3bb-5490-45f9-ba75-3927e8a31f69 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:57.980449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a3bb-5490-45f9-ba75-3927e8a31f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:58.046194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e4f5a3bb-5490-45f9-ba75-3927e8a31f69 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:16:58.047390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4f5a3bb-5490-45f9-ba75-3927e8a31f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:58.056064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:58.145456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:16:58.431591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11d26c-aa6d-44cf-b84f-333719a7959d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:16:58.433215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cf11d26c-aa6d-44cf-b84f-333719a7959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:58.537007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11d26c-aa6d-44cf-b84f-333719a7959d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:16:58.593961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:58.612958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:16:58.613791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:16:58.614407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:16:58.614849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:16:58.617038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:16:58.724646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:16:58.726570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b11bc-fe58-43e4-9a97-1c3d9810b710 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:16:58.744103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 741/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:00.971874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5279d4-73b1-45db-a48b-b7e483817a8e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:00.972384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5279d4-73b1-45db-a48b-b7e483817a8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:00.972384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5279d4-73b1-45db-a48b-b7e483817a8e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:00.973818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:00.979289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f3fca-6765-4e3a-9967-9b417a542eff None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:00.979719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f3fca-6765-4e3a-9967-9b417a542eff None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:00.979834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f3fca-6765-4e3a-9967-9b417a542eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.050573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4a7f3fca-6765-4e3a-9967-9b417a542eff None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:01.051767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4a7f3fca-6765-4e3a-9967-9b417a542eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.091629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:01.151628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:01.435438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5279d4-73b1-45db-a48b-b7e483817a8e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:01.437039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d5279d4-73b1-45db-a48b-b7e483817a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.542029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5279d4-73b1-45db-a48b-b7e483817a8e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:01.579504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:01.616080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:01.616715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:01.617238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:01.617715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:01.619464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:01.732990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:01.734329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3b75-5696-4a18-8b35-e39cd4854729 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:01.873014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 722/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:04.182448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675bbe-bb2b-45c6-a259-153274adb931 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:04.183049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675bbe-bb2b-45c6-a259-153274adb931 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:04.183049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675bbe-bb2b-45c6-a259-153274adb931 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:04.184308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:04.189530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042a78-4e39-4059-a807-948cf2974a18 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:04.189930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042a78-4e39-4059-a807-948cf2974a18 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:04.190065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc042a78-4e39-4059-a807-948cf2974a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:04.256197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dc042a78-4e39-4059-a807-948cf2974a18 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:04.257666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc042a78-4e39-4059-a807-948cf2974a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:04.275228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:04.353750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:04.636273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73675bbe-bb2b-45c6-a259-153274adb931 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:04.637834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-73675bbe-bb2b-45c6-a259-153274adb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:04.739939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73675bbe-bb2b-45c6-a259-153274adb931 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:04.807015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:04.813895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:04.814495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:04.814770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:04.815038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:04.816613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:04.926806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:04.928150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f982cc4-646e-477a-9f18-a808eb4734db service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:04.946475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 744/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:07.213537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd88a5-a333-4006-ad32-d97ef7a5d28b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.214060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd88a5-a333-4006-ad32-d97ef7a5d28b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.214060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd88a5-a333-4006-ad32-d97ef7a5d28b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.215396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:07.220607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336712-8b8b-4085-b2ec-b10de638e70a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.221062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336712-8b8b-4085-b2ec-b10de638e70a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.221174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336712-8b8b-4085-b2ec-b10de638e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.286695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-69336712-8b8b-4085-b2ec-b10de638e70a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:07.287915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-69336712-8b8b-4085-b2ec-b10de638e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:07.335650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:07.383592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:07.667751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd88a5-a333-4006-ad32-d97ef7a5d28b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:07.669362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dcdd88a5-a333-4006-ad32-d97ef7a5d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:07.769827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd88a5-a333-4006-ad32-d97ef7a5d28b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:07.817181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:07.843772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:07.844383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:07.844655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:07.844952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:07.846524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:07.952894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:07.954216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925858f-1764-4d64-8b0c-06116319f1a4 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:07.971484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 725/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:17.381186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=22 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:17.969227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=66 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:28.177544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b35df6-4dec-4a7c-8ed7-1dd71aae64e0 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:28.178122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b35df6-4dec-4a7c-8ed7-1dd71aae64e0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:28.178122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b35df6-4dec-4a7c-8ed7-1dd71aae64e0 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:28.179457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 746/1471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:28.184708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabe0c-704e-4c3c-a058-bd47e03784d5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:28.185182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabe0c-704e-4c3c-a058-bd47e03784d5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:28.185291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aabe0c-704e-4c3c-a058-bd47e03784d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:28.250628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-48aabe0c-704e-4c3c-a058-bd47e03784d5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:28.251822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-48aabe0c-704e-4c3c-a058-bd47e03784d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:28.346244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 726/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:28.651832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea1b5-d2d3-45b8-8f98-9ed88f78f94e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:28.652110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea1b5-d2d3-45b8-8f98-9ed88f78f94e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:28.652375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea1b5-d2d3-45b8-8f98-9ed88f78f94e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:28.653730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 747/1473] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 28 12:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:28.658781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a9342-bbc1-4fdc-af3f-fac3c1dbca4c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:28.659063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a9342-bbc1-4fdc-af3f-fac3c1dbca4c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:28.659331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a9342-bbc1-4fdc-af3f-fac3c1dbca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:28.734389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f48a9342-bbc1-4fdc-af3f-fac3c1dbca4c None None] MFA Rules not processed for user `83cabf530a454894816fbc457fa9a808`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:28.735569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f48a9342-bbc1-4fdc-af3f-fac3c1dbca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:28.756239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:28.814430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 727/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 28 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:28.822300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea1b5-d2d3-45b8-8f98-9ed88f78f94e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:28.823838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-677ea1b5-d2d3-45b8-8f98-9ed88f78f94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:28.926157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea1b5-d2d3-45b8-8f98-9ed88f78f94e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:28.999390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:28.999988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:29.000263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:29.000531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:29.002166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:29.055642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:29.109943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:29.111349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cff97-9c46-4808-a688-66fe63ca2d7b service glance] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:29.129436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 748/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:31.370611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbbcb-08ca-4e61-a3c5-7c3892481fcd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:31.371270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbbcb-08ca-4e61-a3c5-7c3892481fcd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:31.371270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbbcb-08ca-4e61-a3c5-7c3892481fcd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:31.372537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 728/1476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:31.377845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9408-02ad-4518-ac06-defe884af9b7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:31.378231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9408-02ad-4518-ac06-defe884af9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:31.378375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9408-02ad-4518-ac06-defe884af9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:31.442880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-942d9408-02ad-4518-ac06-defe884af9b7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:31.444225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-942d9408-02ad-4518-ac06-defe884af9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:31.542165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 749/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:31.816582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcbbcb-08ca-4e61-a3c5-7c3892481fcd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:31.818184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffdcbbcb-08ca-4e61-a3c5-7c3892481fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:31.947964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcbbcb-08ca-4e61-a3c5-7c3892481fcd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:31.996653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:32.040255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:32.040881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:32.041156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:32.041422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:32.042053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:32.043773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:17:32.043773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:17:32.043773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:17:32.044909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a62121-0b48-47fc-a373-a08d6d350683 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:32.063867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 729/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 28 12:17:31 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:17:34.271150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10842b6d-8c50-4e00-afaf-939c2276ca07 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:34.271690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10842b6d-8c50-4e00-afaf-939c2276ca07 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:34.271690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10842b6d-8c50-4e00-afaf-939c2276ca07 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:34.273937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 750/1479] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:34.279174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e98804-c8a7-46e2-b5cd-c7b35781dabd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:34.279606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e98804-c8a7-46e2-b5cd-c7b35781dabd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:34.279723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e98804-c8a7-46e2-b5cd-c7b35781dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:34.346313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d5e98804-c8a7-46e2-b5cd-c7b35781dabd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:34.347606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d5e98804-c8a7-46e2-b5cd-c7b35781dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:34.443083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 730/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:34.743617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10842b6d-8c50-4e00-afaf-939c2276ca07 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:34.745199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-10842b6d-8c50-4e00-afaf-939c2276ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:34.754754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:34.891118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10842b6d-8c50-4e00-afaf-939c2276ca07 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:34.970222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:35.002807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:35.003402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:35.003704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:35.004004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:35.005621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:35.096091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:35.097680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f6a75-a054-4c4f-afe6-8dd0a3c4f287 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:35.115654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 751/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:37.455923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a2ba-3322-4760-9297-f837e49012b3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:37.456490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a2ba-3322-4760-9297-f837e49012b3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:37.456490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a2ba-3322-4760-9297-f837e49012b3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:37.457852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 731/1482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:37.463587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7bebb-9ed0-4aec-a143-49902c956645 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:37.464017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7bebb-9ed0-4aec-a143-49902c956645 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:37.464135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7bebb-9ed0-4aec-a143-49902c956645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:37.528985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0cb7bebb-9ed0-4aec-a143-49902c956645 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:37.530159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0cb7bebb-9ed0-4aec-a143-49902c956645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:37.575345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:37.626158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 752/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:37.917479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18a2ba-3322-4760-9297-f837e49012b3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:37.919019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d18a2ba-3322-4760-9297-f837e49012b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:37.942186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:38.022762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18a2ba-3322-4760-9297-f837e49012b3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:38.096315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:38.096950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:38.097225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:38.097487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:38.099071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:38.170909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:38.206174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:38.207649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c52b31-7540-46ce-8074-4d76621a98cb service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:38.225770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 732/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:40.437354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5df05-fda1-4d14-a878-4b75cfe6138a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.437920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5df05-fda1-4d14-a878-4b75cfe6138a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.437920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5df05-fda1-4d14-a878-4b75cfe6138a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.439231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 753/1485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:40.444475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cf49b-ba04-43bb-9b2e-2a82d4533664 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:40.444931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cf49b-ba04-43bb-9b2e-2a82d4533664 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:40.445037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cf49b-ba04-43bb-9b2e-2a82d4533664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:40.510321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-be7cf49b-ba04-43bb-9b2e-2a82d4533664 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:40.511523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-be7cf49b-ba04-43bb-9b2e-2a82d4533664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:40.607519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 733/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:40.900686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5df05-fda1-4d14-a878-4b75cfe6138a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:40.902262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-73f5df05-fda1-4d14-a878-4b75cfe6138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:41.003719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5df05-fda1-4d14-a878-4b75cfe6138a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:41.074751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:41.076221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:41.077194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:41.077427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:41.077701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:41.079849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:41.186884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:41.188302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8aa8a-7acb-4f3f-bd5a-aa592ae68d41 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:41.206653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 754/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:43.507210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f7a30-e826-406f-b8bd-27e73ced789e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:43.507796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f7a30-e826-406f-b8bd-27e73ced789e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:43.507796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f7a30-e826-406f-b8bd-27e73ced789e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:43.509131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 734/1488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:43.514444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e9b76-3f11-48c2-a519-eb146a96aae5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:43.514885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e9b76-3f11-48c2-a519-eb146a96aae5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:43.514998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e9b76-3f11-48c2-a519-eb146a96aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:43.579457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-188e9b76-3f11-48c2-a519-eb146a96aae5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:43.580623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-188e9b76-3f11-48c2-a519-eb146a96aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:43.633316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:43.676875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 755/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:43.973681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f7a30-e826-406f-b8bd-27e73ced789e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:43.975204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b76f7a30-e826-406f-b8bd-27e73ced789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.011005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:44.078410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f7a30-e826-406f-b8bd-27e73ced789e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:44.150444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:44.151043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:44.151321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:44.151588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:44.153187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:44.232408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:44.262021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:44.263443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0be8cb-2b3e-4078-9fa9-c3dab3541bd9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:44.280856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 735/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:46.639352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774309a-9fd0-42f4-b589-ff7586fed9a8 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:46.639859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774309a-9fd0-42f4-b589-ff7586fed9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:46.639964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774309a-9fd0-42f4-b589-ff7586fed9a8 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:46.641314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 756/1491] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 28 12:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:17:46.646435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abffe33-4174-4261-b799-f385c441c392 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:46.646861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abffe33-4174-4261-b799-f385c441c392 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:46.647005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abffe33-4174-4261-b799-f385c441c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:46.712550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8abffe33-4174-4261-b799-f385c441c392 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:17:46.713807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8abffe33-4174-4261-b799-f385c441c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:46.809967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 736/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 28 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:17:47.105994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774309a-9fd0-42f4-b589-ff7586fed9a8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:17:47.107554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c774309a-9fd0-42f4-b589-ff7586fed9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:47.211128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774309a-9fd0-42f4-b589-ff7586fed9a8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:17:47.283349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:17:47.283949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:17:47.284222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:17:47.284490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:17:47.286119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:17:47.295526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:47.395241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:17:47.396598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55b031-13a7-4399-895f-45fe14c7f174 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:17:47.415674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 757/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:17:56.808339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=82 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:57.413419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=50 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:12.808337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:12.808813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:12.808935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:12.883112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:12.884610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:12.980297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 737/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:12.988207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:12.988691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:12.988826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:13.065521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:13.066711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:13.160887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 758/1495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:19:13.166086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:13.167267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:13.178448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f2b30-1642-4b4b-aeac-6c388635c2ff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:13.239539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:13.272511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:13.273148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:13.273423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:13.273691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:13.274324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:19:13.275208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:13.276218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:13.276218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:19:13.276218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:19:13.277115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:13.288072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 738/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:19:13.297035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:13.306761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7b6c-dd80-4a11-9ae1-e1a86530854a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:13.366239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:13.399313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:13.400798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:13.401066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:13.401327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:13.401952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:13.403677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:13.403677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:19:13.403677 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:19:13.404833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:13.459905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 759/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:19:13 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:19:13.464702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:13.466255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:13.499516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc4930-761c-4de6-b6ee-12d49c91fa58 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:13.592174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:13.592769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:13.593069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:13.593332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:13.593939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:13.594926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:13.594926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:19:13.594926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:19:13.596101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:13.637667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 739/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:19:13 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:19:13.641826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:13.643344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:13.704558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f7c6f-6189-4175-803e-1d108ddc2a4d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:13.786814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:13.798162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:13.798850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:13.799122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:13.799387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:13.800031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:13.801277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:13.801277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:19:13.801277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:19:13.802165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:13.814794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 760/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:19:13.818864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:13.820394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:13.832834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9214d-969b-44cd-8ded-07255f3e099d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:13.858280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:13.929448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:13.930065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:13.930343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:13.931114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:13.931989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:13.933024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:13.933024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:19:13.933024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:19:13.933913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250aeee-2915-4918-b1d4-07d63749488e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:13.946142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 740/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:19:13.950886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:13.952402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:13.986945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618094ac-3b49-4148-b8c6-968fa54c38bd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:14.079613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:14.080277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:14.080518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:14.080804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] PATH_INFO: `/v3/projects/4f7d0aa0a9c841edb1d0c3e57afb1699/users/6a7b05280a43491ab4c6fd2a3f22ef43/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:14.104262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7d0aa0a9c841edb1d0c3e57afb1699, user_id=6a7b05280a43491ab4c6fd2a3f22ef43, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:14.105332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:14.105332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:19:14.105332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:19:14.107256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5f703-ee1c-40c6-af63-d044050cd8e6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:14.131458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 761/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:19:13 2022] PUT /identity/v3/projects/4f7d0aa0a9c841edb1d0c3e57afb1699/users/6a7b05280a43491ab4c6fd2a3f22ef43/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:14.144319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc10fa-d31d-4f67-8368-4a8f9521614c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:14.144609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc10fa-d31d-4f67-8368-4a8f9521614c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:14.144925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc10fa-d31d-4f67-8368-4a8f9521614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:14.201057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5cbc10fa-d31d-4f67-8368-4a8f9521614c None None] MFA Rules not processed for user `6a7b05280a43491ab4c6fd2a3f22ef43`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:14.202279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5cbc10fa-d31d-4f67-8368-4a8f9521614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:14.279971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 741/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:14.293977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b0d0-538f-4175-b8c6-8be0a0b34049 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:14.294257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b0d0-538f-4175-b8c6-8be0a0b34049 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:14.294526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b0d0-538f-4175-b8c6-8be0a0b34049 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:14.295877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 762/1503] 10.222.0.27 () {54 vars in 963 bytes} [Wed Sep 28 12:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:19:14.300510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f345a-1086-491b-ab11-20f3a31d0113 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:14.300824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f345a-1086-491b-ab11-20f3a31d0113 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:14.301101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f345a-1086-491b-ab11-20f3a31d0113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:14.334364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:14.381370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ec1f345a-1086-491b-ab11-20f3a31d0113 None None] MFA Rules not processed for user `f68ebccd64bc49d8a6c6d05d50ce2b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:14.382565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec1f345a-1086-491b-ab11-20f3a31d0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:14.456861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 742/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Sep 28 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:14.464586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b0d0-538f-4175-b8c6-8be0a0b34049 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:14.466155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5e27b0d0-538f-4175-b8c6-8be0a0b34049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:14.516518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:14.571466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b0d0-538f-4175-b8c6-8be0a0b34049 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:14.644873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:14.645480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:14.645752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:14.646015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:14.647587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:14.745232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:14.746688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:14.750137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:14.765391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 763/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:14.811831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462df4b-00f5-47f5-bbfc-39a6e64ff8e8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:14.812122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462df4b-00f5-47f5-bbfc-39a6e64ff8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:14.812396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462df4b-00f5-47f5-bbfc-39a6e64ff8e8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:14.813696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 743/1506] 10.222.0.27 () {52 vars in 830 bytes} [Wed Sep 28 12:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:19:14.817358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:14.818551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:14.918114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af317-198b-4ba2-9173-470019b6fdd2 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:15.010345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:15.010955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:15.011223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:15.011485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] PATH_INFO: `/v3/users/6a7b05280a43491ab4c6fd2a3f22ef43` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:15.024130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7b05280a43491ab4c6fd2a3f22ef43)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:15.025791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:15.025791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:19:15.025791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:19:15.026986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:15.036370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:15.093206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7b05280a43491ab4c6fd2a3f22ef43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:15.093863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7b05280a43491ab4c6fd2a3f22ef43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:15.094147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7b05280a43491ab4c6fd2a3f22ef43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:15.102872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7b05280a43491ab4c6fd2a3f22ef43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:15.116900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7b05280a43491ab4c6fd2a3f22ef43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:15.144984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 764/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:19:14 2022] DELETE /identity/v3/users/6a7b05280a43491ab4c6fd2a3f22ef43 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:15.149975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:15.150449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:15.150594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:15.206427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:19:15.207557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:15.282669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:15.295241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 744/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:19:15.305378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:15.306723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:15.404058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7e4f-0ec1-4cd6-8d37-396317876866 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:15.459968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:15.480052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:15.480656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:15.480952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:15.481217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:15.482801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:15.590987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:15.592416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231f691-8f9c-4708-9d64-63de21d602a9 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:15.609896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 765/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:19:15.974312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:19:15.975578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:19:15.987942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6206c6-667b-4ffc-8960-ae7d6987adbe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:19:16.085288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:19:16.085924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:19:16.086201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:19:16.086474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] PATH_INFO: `/v3/projects/4f7d0aa0a9c841edb1d0c3e57afb1699` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:19:16.096154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7d0aa0a9c841edb1d0c3e57afb1699)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:19:16.097196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:19:16.097196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:19:16.097196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:19:16.098386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:19:16.157995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7d0aa0a9c841edb1d0c3e57afb1699', 'request_id': 'req-e469b7ff-6205-488a-989a-5e89750fde29'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:16.166898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7d0aa0a9c841edb1d0c3e57afb1699', 'request_id': 'req-e469b7ff-6205-488a-989a-5e89750fde29'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:16.179903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7d0aa0a9c841edb1d0c3e57afb1699', 'request_id': 'req-e469b7ff-6205-488a-989a-5e89750fde29'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:16.201854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] The token cache is being invalidate because project 4f7d0aa0a9c841edb1d0c3e57afb1699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:19:16.202142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:16.202568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e469b7ff-6205-488a-989a-5e89750fde29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:19:16.204202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 745/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:19:15 2022] DELETE /identity/v3/projects/4f7d0aa0a9c841edb1d0c3e57afb1699 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:19:25.607651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=62 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:26.199822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:48.766232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87bdd4-d9b8-498b-9ac3-3b67d1582e15 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.766806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87bdd4-d9b8-498b-9ac3-3b67d1582e15 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.766806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87bdd4-d9b8-498b-9ac3-3b67d1582e15 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.768151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:20:48.772970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313838-40f0-4db3-beae-98db0d82c058 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:48.773414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313838-40f0-4db3-beae-98db0d82c058 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:48.773527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313838-40f0-4db3-beae-98db0d82c058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:48.854364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b313838-40f0-4db3-beae-98db0d82c058 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:48.855574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b313838-40f0-4db3-beae-98db0d82c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:48.958463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:49.113586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87bdd4-d9b8-498b-9ac3-3b67d1582e15 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:49.115699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c87bdd4-d9b8-498b-9ac3-3b67d1582e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:49.233118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87bdd4-d9b8-498b-9ac3-3b67d1582e15 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:49.238499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111db859-e75d-4427-9e82-e43f2754790b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:49.239083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db859-e75d-4427-9e82-e43f2754790b service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:49.239358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db859-e75d-4427-9e82-e43f2754790b service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:49.239624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db859-e75d-4427-9e82-e43f2754790b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:49.248224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111db859-e75d-4427-9e82-e43f2754790b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:49.249819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111db859-e75d-4427-9e82-e43f2754790b service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:49.259203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 767/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:50.353858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc30f0-61ab-4eb2-bef1-5c9786ce34db None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:50.354419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc30f0-61ab-4eb2-bef1-5c9786ce34db None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:50.354419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc30f0-61ab-4eb2-bef1-5c9786ce34db None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:50.355750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:20:50.362120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87deb-e76e-4213-b94f-de680ca33b5e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:50.362582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87deb-e76e-4213-b94f-de680ca33b5e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:50.362680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca87deb-e76e-4213-b94f-de680ca33b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:50.382466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7ca87deb-e76e-4213-b94f-de680ca33b5e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:50.383733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7ca87deb-e76e-4213-b94f-de680ca33b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:50.391990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:50.544852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc30f0-61ab-4eb2-bef1-5c9786ce34db None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:50.558833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc30f0-61ab-4eb2-bef1-5c9786ce34db None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:50.564109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed832472-dc09-4792-9e3c-56950778c0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:50.564696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed832472-dc09-4792-9e3c-56950778c0ee service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:50.565002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed832472-dc09-4792-9e3c-56950778c0ee service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:50.565271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed832472-dc09-4792-9e3c-56950778c0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:50.573366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed832472-dc09-4792-9e3c-56950778c0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:50.574936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed832472-dc09-4792-9e3c-56950778c0ee service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:50.584284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 748/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:20:50.887408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97b7ac-5dcc-4801-8a59-a7346290434b None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:50.887623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97b7ac-5dcc-4801-8a59-a7346290434b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:50.887862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97b7ac-5dcc-4801-8a59-a7346290434b None None] PATH_INFO: `/v3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:50.889211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 769/1517] 10.222.0.55 () {54 vars in 925 bytes} [Wed Sep 28 12:20:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:20:50.918462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd650-0a95-4bd3-9b42-b94ed4b121b8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:50.918749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd650-0a95-4bd3-9b42-b94ed4b121b8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:50.919027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd650-0a95-4bd3-9b42-b94ed4b121b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:50.978307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-854cd650-0a95-4bd3-9b42-b94ed4b121b8 None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:50.979514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-854cd650-0a95-4bd3-9b42-b94ed4b121b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:50.997022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:20:51.050773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 749/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Sep 28 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:54.584957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef38e16-c90d-4de6-b72d-aa5ccbee41cc None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:54.585438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef38e16-c90d-4de6-b72d-aa5ccbee41cc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:54.585546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef38e16-c90d-4de6-b72d-aa5ccbee41cc None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:54.586817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 770/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 28 12:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:20:54.591867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961dff-0f79-408b-a0d8-1273083c42ab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:54.592326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961dff-0f79-408b-a0d8-1273083c42ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:54.592443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99961dff-0f79-408b-a0d8-1273083c42ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:54.612412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-99961dff-0f79-408b-a0d8-1273083c42ab None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:20:54.613654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99961dff-0f79-408b-a0d8-1273083c42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:20:54.623208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 750/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 28 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:20:54.630871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef38e16-c90d-4de6-b72d-aa5ccbee41cc None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:20:54.644208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef38e16-c90d-4de6-b72d-aa5ccbee41cc None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:20:54.649290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38a765-5a9b-4506-a76d-77ee4ff86713 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:20:54.649943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a765-5a9b-4506-a76d-77ee4ff86713 service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:20:54.650404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a765-5a9b-4506-a76d-77ee4ff86713 service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:20:54.650679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38a765-5a9b-4506-a76d-77ee4ff86713 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:20:54.658802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a765-5a9b-4506-a76d-77ee4ff86713 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:20:54.660361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38a765-5a9b-4506-a76d-77ee4ff86713 service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:20:54.670624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 771/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:21:02.068604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd39f9-1712-40e3-b4c0-3aa3d1d29b5e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:02.069192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd39f9-1712-40e3-b4c0-3aa3d1d29b5e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:02.069192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd39f9-1712-40e3-b4c0-3aa3d1d29b5e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:02.070553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:21:02.076741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7753a-cfdd-4e55-8f0c-d2373cbbb0cd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:02.077193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7753a-cfdd-4e55-8f0c-d2373cbbb0cd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:02.077312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7753a-cfdd-4e55-8f0c-d2373cbbb0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:02.096586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-95c7753a-cfdd-4e55-8f0c-d2373cbbb0cd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:02.097813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-95c7753a-cfdd-4e55-8f0c-d2373cbbb0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:02.106164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:02.259145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd39f9-1712-40e3-b4c0-3aa3d1d29b5e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:02.273464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd39f9-1712-40e3-b4c0-3aa3d1d29b5e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:02.278954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498d71c-5037-4e4f-9d8b-7701fcaef984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:02.279541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d71c-5037-4e4f-9d8b-7701fcaef984 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:02.279818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d71c-5037-4e4f-9d8b-7701fcaef984 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:02.280087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498d71c-5037-4e4f-9d8b-7701fcaef984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:02.288056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d71c-5037-4e4f-9d8b-7701fcaef984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:02.289652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498d71c-5037-4e4f-9d8b-7701fcaef984 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:02.299364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 752/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:03.370751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188824e-a2dc-4381-9e8d-b0f9218e0563 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:03.371357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188824e-a2dc-4381-9e8d-b0f9218e0563 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:03.371357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188824e-a2dc-4381-9e8d-b0f9218e0563 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:03.372627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 12:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:21:03.378843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9fb3-a542-4b1d-b130-2949cb4f9362 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:03.379292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9fb3-a542-4b1d-b130-2949cb4f9362 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:03.379493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9fb3-a542-4b1d-b130-2949cb4f9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:03.400896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3cb9fb3-a542-4b1d-b130-2949cb4f9362 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:03.401812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3cb9fb3-a542-4b1d-b130-2949cb4f9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:03.409605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:03.561381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188824e-a2dc-4381-9e8d-b0f9218e0563 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:03.576351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188824e-a2dc-4381-9e8d-b0f9218e0563 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:03.582110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6adefb-d88f-4836-a0e8-5edd611f5b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:03.582696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6adefb-d88f-4836-a0e8-5edd611f5b38 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:03.582966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6adefb-d88f-4836-a0e8-5edd611f5b38 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:03.583233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6adefb-d88f-4836-a0e8-5edd611f5b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:03.591209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6adefb-d88f-4836-a0e8-5edd611f5b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:03.592786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6adefb-d88f-4836-a0e8-5edd611f5b38 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:03.602182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 774/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:07.470086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c9ed-f19a-40e0-8ddf-1ea84a947b3d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:07.470687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c9ed-f19a-40e0-8ddf-1ea84a947b3d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:07.470687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756c9ed-f19a-40e0-8ddf-1ea84a947b3d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:07.471978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:21:07.477211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435883-83a3-4b02-a8a8-d83844654846 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:07.477640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435883-83a3-4b02-a8a8-d83844654846 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:07.477739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435883-83a3-4b02-a8a8-d83844654846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:07.498034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f3435883-83a3-4b02-a8a8-d83844654846 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:07.499229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f3435883-83a3-4b02-a8a8-d83844654846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:07.507083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:07.794722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756c9ed-f19a-40e0-8ddf-1ea84a947b3d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:07.796422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e756c9ed-f19a-40e0-8ddf-1ea84a947b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:07.873696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756c9ed-f19a-40e0-8ddf-1ea84a947b3d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:07.877203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d178ba3-88f6-4e7c-a0b8-f5761709f72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:07.877793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d178ba3-88f6-4e7c-a0b8-f5761709f72a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:07.878070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d178ba3-88f6-4e7c-a0b8-f5761709f72a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:07.878334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d178ba3-88f6-4e7c-a0b8-f5761709f72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:07.887721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d178ba3-88f6-4e7c-a0b8-f5761709f72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:07.889168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d178ba3-88f6-4e7c-a0b8-f5761709f72a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:07.898420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 755/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:10.042481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0bc19-4cb7-4195-abdc-1e79e9b0de65 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:10.043037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0bc19-4cb7-4195-abdc-1e79e9b0de65 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:10.043037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0bc19-4cb7-4195-abdc-1e79e9b0de65 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:10.044370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:21:10.049641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23094859-8835-4607-afac-90762eb777fa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:10.050070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23094859-8835-4607-afac-90762eb777fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:10.050207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23094859-8835-4607-afac-90762eb777fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:10.070805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23094859-8835-4607-afac-90762eb777fa None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:10.072071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23094859-8835-4607-afac-90762eb777fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:10.080114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:10.376415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0bc19-4cb7-4195-abdc-1e79e9b0de65 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:10.387459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0bc19-4cb7-4195-abdc-1e79e9b0de65 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:10.391061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c59fa-4293-497c-bc6b-243cd2922658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:10.391657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c59fa-4293-497c-bc6b-243cd2922658 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:10.391932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c59fa-4293-497c-bc6b-243cd2922658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:10.392201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c59fa-4293-497c-bc6b-243cd2922658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:10.401672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c59fa-4293-497c-bc6b-243cd2922658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:10.403182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c59fa-4293-497c-bc6b-243cd2922658 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:10.412517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 777/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:13.999617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04abbc8-8db3-4b0b-80ee-b588717a80d6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:14.000433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04abbc8-8db3-4b0b-80ee-b588717a80d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:14.000620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04abbc8-8db3-4b0b-80ee-b588717a80d6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:14.002096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:21:14.007208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b26c-9f93-408b-a9d7-53d67a5e0607 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:14.007626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b26c-9f93-408b-a9d7-53d67a5e0607 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:14.007736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b26c-9f93-408b-a9d7-53d67a5e0607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:14.027857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e054b26c-9f93-408b-a9d7-53d67a5e0607 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:14.029056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e054b26c-9f93-408b-a9d7-53d67a5e0607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:14.036874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:14.343831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04abbc8-8db3-4b0b-80ee-b588717a80d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:14.345745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d04abbc8-8db3-4b0b-80ee-b588717a80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:14.412946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:14.426729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04abbc8-8db3-4b0b-80ee-b588717a80d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:14.430233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e21093-07c5-484f-bb07-5e1c3e6e0631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:14.430830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e21093-07c5-484f-bb07-5e1c3e6e0631 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:14.431108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e21093-07c5-484f-bb07-5e1c3e6e0631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:14.431375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e21093-07c5-484f-bb07-5e1c3e6e0631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:14.440868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e21093-07c5-484f-bb07-5e1c3e6e0631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:14.442278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e21093-07c5-484f-bb07-5e1c3e6e0631 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:14.452001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 758/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:16.606270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25d13-d9c7-4eba-a42d-eaa3692c99e1 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:16.606846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25d13-d9c7-4eba-a42d-eaa3692c99e1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:16.606846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25d13-d9c7-4eba-a42d-eaa3692c99e1 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:16.608155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 12:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:21:16.613330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0506-0b8a-465e-8240-50d3ba887a02 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:16.613730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0506-0b8a-465e-8240-50d3ba887a02 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:16.613872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0506-0b8a-465e-8240-50d3ba887a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:16.632959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0e1d0506-0b8a-465e-8240-50d3ba887a02 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:21:16.634149 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e1d0506-0b8a-465e-8240-50d3ba887a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:16.642939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:21:16.948756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25d13-d9c7-4eba-a42d-eaa3692c99e1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:21:16.950426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a3b25d13-d9c7-4eba-a42d-eaa3692c99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:21:16.958176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:16.964495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25d13-d9c7-4eba-a42d-eaa3692c99e1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:21:16.967971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054e046-f4ed-451c-a022-ad11be04be2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:21:16.968555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e046-f4ed-451c-a022-ad11be04be2f service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:21:16.968869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e046-f4ed-451c-a022-ad11be04be2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:21:16.969140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054e046-f4ed-451c-a022-ad11be04be2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:21:16.977815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054e046-f4ed-451c-a022-ad11be04be2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:21:16.979364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054e046-f4ed-451c-a022-ad11be04be2f service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:21:16.988479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 780/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:21:26.628019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=11 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:26.984383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:46.072208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b765-003b-4ba5-9c9b-d231ff460729 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.072853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b765-003b-4ba5-9c9b-d231ff460729 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.072853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b765-003b-4ba5-9c9b-d231ff460729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.096350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0c59b765-003b-4ba5-9c9b-d231ff460729 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.097574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c59b765-003b-4ba5-9c9b-d231ff460729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.109638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 760/1540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.118791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.119362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.119362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.147517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.148735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.158042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f6a38-3e0c-48ef-9405-ccb046b99d6e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.158347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f6a38-3e0c-48ef-9405-ccb046b99d6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.158580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f6a38-3e0c-48ef-9405-ccb046b99d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.161597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 781/1541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.167237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.183622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb924-afd1-4e1b-8791-a79baf6b2ba0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.189830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8e7f6a38-3e0c-48ef-9405-ccb046b99d6e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.193613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8e7f6a38-3e0c-48ef-9405-ccb046b99d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.195022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.195905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.196221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.196499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.197196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.197455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.198477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:22:46.198477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:22:46.198477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:22:46.199359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93930-3ae1-4b47-9c29-ff29d3095549 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.219235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 761/1542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:22:46.220507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595f7c-4be4-4f3c-b971-aaa479d6568d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.220800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595f7c-4be4-4f3c-b971-aaa479d6568d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.221093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595f7c-4be4-4f3c-b971-aaa479d6568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.226492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 782/1543] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.233382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43d19-695a-41e9-9b7e-4a92c27711b9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.233665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43d19-695a-41e9-9b7e-4a92c27711b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.233933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43d19-695a-41e9-9b7e-4a92c27711b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.268934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-77595f7c-4be4-4f3c-b971-aaa479d6568d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.270227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-77595f7c-4be4-4f3c-b971-aaa479d6568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.272161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2ef43d19-695a-41e9-9b7e-4a92c27711b9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.275525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ef43d19-695a-41e9-9b7e-4a92c27711b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.284136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 762/1544] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.286128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.286412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.286686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.295090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 783/1545] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.296450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184dde-ccfa-4c47-91de-7153fd7f5e73 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.296737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184dde-ccfa-4c47-91de-7153fd7f5e73 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.297036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184dde-ccfa-4c47-91de-7153fd7f5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.318271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.320479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.322144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3b184dde-ccfa-4c47-91de-7153fd7f5e73 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.323594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3b184dde-ccfa-4c47-91de-7153fd7f5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.330243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 763/1546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.337404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.341440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 784/1547] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.342628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83459c2-fd7d-42c3-b6b6-e663d2c2ad74 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.342761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b12678-d46e-4265-993f-0faa81a0d2a9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.342941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83459c2-fd7d-42c3-b6b6-e663d2c2ad74 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.343169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83459c2-fd7d-42c3-b6b6-e663d2c2ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.347352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.347959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.348364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.348642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.349299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.350868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:22:46.350868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:22:46.350868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:22:46.352055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.363808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e83459c2-fd7d-42c3-b6b6-e663d2c2ad74 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.365050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e83459c2-fd7d-42c3-b6b6-e663d2c2ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.374780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 785/1548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.376011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8a49-3d14-4c22-92f8-77ab2d6e567a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.376293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8a49-3d14-4c22-92f8-77ab2d6e567a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.376562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8a49-3d14-4c22-92f8-77ab2d6e567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.396684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 764/1549] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:46.396965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-61ad8a49-3d14-4c22-92f8-77ab2d6e567a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.397970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.398189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-61ad8a49-3d14-4c22-92f8-77ab2d6e567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.459518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 786/1550] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.460910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5396-3f30-4108-aaf6-36eda2b545fb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.461058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703d63f-f548-4070-9dfb-58ac01889af8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.461173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5396-3f30-4108-aaf6-36eda2b545fb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.461456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe5396-3f30-4108-aaf6-36eda2b545fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.466409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.467014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.467296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.467567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.468208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.468512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.470132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5db15-d979-4e14-a5c4-d47b7999d7fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.481379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4bfe5396-3f30-4108-aaf6-36eda2b545fb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.488870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 765/1551] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.489042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4bfe5396-3f30-4108-aaf6-36eda2b545fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.489143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9f951-bcb2-4da3-a774-2f50178e999b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.489143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9f951-bcb2-4da3-a774-2f50178e999b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.489143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9f951-bcb2-4da3-a774-2f50178e999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.495053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 787/1552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.496262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074a13-aa35-40e7-84ca-ab6b739bc39c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.496547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074a13-aa35-40e7-84ca-ab6b739bc39c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.496844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6074a13-aa35-40e7-84ca-ab6b739bc39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.506043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0db9f951-bcb2-4da3-a774-2f50178e999b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.507254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0db9f951-bcb2-4da3-a774-2f50178e999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.515919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 766/1553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.517122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.517398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.517664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.520508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b6074a13-aa35-40e7-84ca-ab6b739bc39c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.521949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6074a13-aa35-40e7-84ca-ab6b739bc39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.531988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 788/1554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.533359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.533666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.533935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.538946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.540426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.548322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 767/1555] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.549121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.557391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.558542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a548f-a5c3-4609-9ee8-ffdb5695e4a4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.558674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.562994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.563571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.563850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.564120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.564730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.566294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 789/1556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.566638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.567044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.577174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f389e-d968-415e-a5a7-0a706233c2c3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.582299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.582923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.583257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.583600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.584433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.584567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.586071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31b4a-1641-4232-aed4-97138e3df149 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.593047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 768/1557] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:46.593047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.598810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 790/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.600076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b708-0319-4411-80a4-22043a78692a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.600353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b708-0319-4411-80a4-22043a78692a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.600618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b708-0319-4411-80a4-22043a78692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.601335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa171-cbed-46f5-bdc6-3805ac5a87f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.609805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eb13d-d1ff-46bf-ad7e-ec9c64f2057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.610432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eb13d-d1ff-46bf-ad7e-ec9c64f2057d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.610703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eb13d-d1ff-46bf-ad7e-ec9c64f2057d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.610972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eb13d-d1ff-46bf-ad7e-ec9c64f2057d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.611588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eb13d-d1ff-46bf-ad7e-ec9c64f2057d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.613494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eb13d-d1ff-46bf-ad7e-ec9c64f2057d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.622481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4124b708-0319-4411-80a4-22043a78692a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.623647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4124b708-0319-4411-80a4-22043a78692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.632534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 791/1559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.633382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b708-0319-4411-80a4-22043a78692a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.643333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b708-0319-4411-80a4-22043a78692a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.648027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 769/1560] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:46.648027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.648027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.648027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.667743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:46.668976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:46.702723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.703320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.703850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.704118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.704766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.705080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.706658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.709483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:46.718648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 792/1561] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.719451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.729605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a386-59df-4673-ab27-a5f0d69bb4b1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.734127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.734704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.734975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.735236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.735893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.736188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.736522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 770/1562] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:46.737464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.737790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.747281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f2e00-dc0f-45b4-9d7f-83312e38b8d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.759316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 793/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.759316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.759674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.759674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.759674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.759674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.760030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.760030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.760030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.760268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:46.766381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957c98-6bb1-4411-9b9a-b46d4a4751ad admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.769189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 771/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.770013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.771046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.771641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.771913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.772178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.772844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.774558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.781459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97d6af-d531-4744-99e8-f41b41cc6966 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.787830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 794/1565] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:46.787830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.788066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.788066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.788066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.788066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.788447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.789582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.799295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f227-0ece-41c9-bbb0-bebfea456db3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.804033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.804632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.804980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.805255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.806730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.807041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.808683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.818531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 772/1566] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:46.819391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.832528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 795/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.832528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.842307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d11a6-a19f-4964-bb65-4c309d89b5ab admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.885777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9e1ac-3e43-46c3-b8ff-3fec998dc850 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.890537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.891139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.891426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.891695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.892315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.894246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.897628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.898273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.898544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.899067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.900346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.902244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.919455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 773/1568] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:46.919455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.926459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f465912-256a-4364-90ef-edf396441cf1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.931712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:46.932331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:46.932605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:46.932898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:46.933403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 796/1569] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:46.933541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:22:46.933836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:46.934281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.935424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:46.955079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 774/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:22:46.955079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:46.965176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d9a5f-5f0a-49a6-9fac-3f1fb690aeb5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:46.997582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1287e-8d77-43c9-9c80-106d00c42c90 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.002267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.002865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.003142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.003413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.004035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.005971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.021009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.021614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.021887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.022151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.022764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.026018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.035295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 797/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.036117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.061345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 775/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:46 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.062341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.078205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:47.086549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:47.102094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311142-d3ce-43cd-9061-e1bc0e82c724 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.130957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520c774-3c9a-4c86-90ac-2afa6d966b85 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.136751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.137380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.137657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.137924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.138542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.140445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.160424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.161057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.161288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.161558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.162199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.162740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 776/1573] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.163526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.166013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.173268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc18a3-e717-4f36-9b3e-fdd93e1061b0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.176513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 798/1574] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.177189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.180921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.181516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.181790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.182120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.182664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.184535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.186856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c76663-0155-4812-a377-c5f5666b1cb6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.191505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.192086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.192415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.192709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.193381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.194997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.206480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 799/1575] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.207329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.213888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 777/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.214931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.218058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b5027-72ab-4413-9a52-ad4874b8e673 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.277782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af461-1498-45d5-a998-189ae9e1742a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.278155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.278700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.278978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.279246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.279872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.280912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:22:47.280912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:22:47.280912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:22:47.282111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.282853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.283460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.283765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.284033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.284649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.286547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.305422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 800/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.306201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.316461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497d943-a9b9-4cee-a43a-52007dfe48f8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.319965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 778/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.319965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.378760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.379249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.379642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.379947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.380575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.382609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.382995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa1f4-c0a1-40b0-9131-1d819f2be428 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.388279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.388908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.389181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.389451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.390115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.392015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.400160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:47.403267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:47.406711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 801/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.407756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.419436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098d32-f939-4bab-8fcc-0e8a9cc5e114 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.423309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 779/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.423309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.425095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.425797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.426145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.426411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.427625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.428999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.431027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab133f-4be1-4790-a46c-789da457a85a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.435635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.436273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.436550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.436848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] PATH_INFO: `/v3/projects/41b959b4494c4d949ae97f84299ad9d2/users/6ebfeba30aa342a99e0d5855f9ac8f12/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.440686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 802/1581] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.441537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.451992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124d1b-ffdf-48cf-aff8-ba0c4e716a2d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.453259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b959b4494c4d949ae97f84299ad9d2, user_id=6ebfeba30aa342a99e0d5855f9ac8f12, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.454555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:22:47.454555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:22:47.454555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:22:47.456456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.457361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.457996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.458277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.458550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.459212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.460833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.470514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 780/1582] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:47 2022] PUT /identity/v3/projects/41b959b4494c4d949ae97f84299ad9d2/users/6ebfeba30aa342a99e0d5855f9ac8f12/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:47.474388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 803/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.474388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.474626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.482220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4164a-dd89-4a43-89ba-2b6ff43762cd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.540342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc5857-0f68-4c73-ac85-d528beddc7f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.542046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b102-0015-451c-9789-b17820724854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.542758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b102-0015-451c-9789-b17820724854 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.543138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b102-0015-451c-9789-b17820724854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.543509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b102-0015-451c-9789-b17820724854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.544253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b102-0015-451c-9789-b17820724854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.544894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.545496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.545793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.546059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.546517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b102-0015-451c-9789-b17820724854 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.546676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.548527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.557306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 804/1584] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.558229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b102-0015-451c-9789-b17820724854 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.568983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b102-0015-451c-9789-b17820724854 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.571044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 781/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.572588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.575181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.575850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.576202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.576543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.577265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.579498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.582645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017897-1c55-4fc3-9415-d2c0b0020ac4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.587219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.587801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.588075 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.588342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.589009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.590565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.600541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 782/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.601371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.606169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 805/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/users => generated 303 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:47.606169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.611713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94284d1-3e1b-417c-b437-68793c4d0739 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.614103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ae33b-d268-4509-9f55-fe5a3ca76471 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.616456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c990c-95fa-41f9-9c17-791a53ea8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.617221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c990c-95fa-41f9-9c17-791a53ea8098 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.617622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c990c-95fa-41f9-9c17-791a53ea8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.618548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c990c-95fa-41f9-9c17-791a53ea8098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.619231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c990c-95fa-41f9-9c17-791a53ea8098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.619959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.620547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.620977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.621144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c990c-95fa-41f9-9c17-791a53ea8098 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.621242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.621732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.623294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.635696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 783/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.635696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.635696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.635696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.636106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 806/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.636106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.645111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdef6e1-6824-4e31-ace0-cda861587308 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.650839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.651551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.651894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.652231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] PATH_INFO: `/v3/projects/64b15185b3aa444eaf71b04c372b7e71/users/778f3756020548dda6e0162f5560a328/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.654192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:47.655398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:47.663185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 784/1590] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:47.664381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.669880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b15185b3aa444eaf71b04c372b7e71, user_id=778f3756020548dda6e0162f5560a328, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.672760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.674666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d16a1-de30-4d3a-a0a4-278159fc3716 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.679979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.680710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.681045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.681357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.681999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.683568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.686721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 807/1591] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:47 2022] PUT /identity/v3/projects/64b15185b3aa444eaf71b04c372b7e71/users/778f3756020548dda6e0162f5560a328/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:47.687547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.697237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 785/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.697237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.707034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ca16-fc00-4d29-9239-1a6bf706a75d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.758601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a0fc7-e508-4710-af50-db8d4efee744 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.763244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.763387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.763845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.763959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.764121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.764228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.764387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.764499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.765143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.765246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.766711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.766820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.777176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 808/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.777841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 786/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.778027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.781509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.787524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765597-f8fc-4742-9078-3de21d3b2422 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.792019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d958-e7bc-4c06-8837-0a5cacea2b9b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.793397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.793985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.794263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.794531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.795178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.796766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.801215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.801821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.802233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.802509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.803143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.804726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.808165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 809/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.809232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.817932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 787/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.818707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470f95-9e02-4f9a-87f4-3f2754314cb7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.818847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.820562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:47.823865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa1e5-ab00-49dc-9342-609b95eaccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.824519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa1e5-ab00-49dc-9342-609b95eaccb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.824809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa1e5-ab00-49dc-9342-609b95eaccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.825091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa1e5-ab00-49dc-9342-609b95eaccb9 admin admin] PATH_INFO: `/v3/projects/a12b079b874b4cf3b9a4f4b9202d880b/users/0c34731e291046cbb634305a95ead7b6/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.826926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:47.827532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:47.843144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa1e5-ab00-49dc-9342-609b95eaccb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12b079b874b4cf3b9a4f4b9202d880b, user_id=0c34731e291046cbb634305a95ead7b6, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.845866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa1e5-ab00-49dc-9342-609b95eaccb9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.859272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 810/1597] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:47 2022] PUT /identity/v3/projects/a12b079b874b4cf3b9a4f4b9202d880b/users/0c34731e291046cbb634305a95ead7b6/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:47.860490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.860794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.861064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.880394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:47.881692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:47.886281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6c10-9a90-4776-9810-8c500346b724 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.934917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.935620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.935968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.936305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.940917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 811/1598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:47.941802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.947647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.949189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.952479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3476-ed11-404d-b1c6-559587952f88 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.957796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.958442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.958719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.958987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] PATH_INFO: `/v3/projects/e0d1f62fb0de450dbb41c236980a16d9/users/c0c517b3f34d440ca41ce746c175319f/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.959138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 788/1599] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:47.959922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.971121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9932-ccc2-469c-96a0-b7fd34553e12 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:47.975127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d1f62fb0de450dbb41c236980a16d9, user_id=c0c517b3f34d440ca41ce746c175319f, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.975639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:47.976263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:47.976636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:47.976981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:47.977653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:47.978404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.979211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:47.994386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 789/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:47.994386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:47.997752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 812/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:47 2022] PUT /identity/v3/projects/e0d1f62fb0de450dbb41c236980a16d9/users/c0c517b3f34d440ca41ce746c175319f/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:47.999156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.002128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcfb31-e414-46fe-9b85-7e5730ed9c25 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.064901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.065517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.065858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.066218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.066908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.068572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.071804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9bc7-2792-44fa-86fc-9b5c8c5b9aee admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.077003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf95fd-7d5f-407d-8d8a-cae8117af7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.077911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf95fd-7d5f-407d-8d8a-cae8117af7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.078363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf95fd-7d5f-407d-8d8a-cae8117af7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.079042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf95fd-7d5f-407d-8d8a-cae8117af7d2 admin admin] PATH_INFO: `/v3/projects/3bf670dfebde4162b335b33c80afeffb/users/8efaf0eb944e4f0bac9a77bca9b68e26/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.080675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 790/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:48.081517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.095705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041ec2-41c9-4728-99c0-c8eb1b30c77d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.098128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf95fd-7d5f-407d-8d8a-cae8117af7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf670dfebde4162b335b33c80afeffb, user_id=8efaf0eb944e4f0bac9a77bca9b68e26, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.101092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.101302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf95fd-7d5f-407d-8d8a-cae8117af7d2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.101928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.102682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.103174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] PATH_INFO: `/v3/projects/cc65c2db73b440bbaedb2af51e6e2899/users/595a1bb3ec224b67885a0851dd540765/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.122178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 813/1603] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:47 2022] PUT /identity/v3/projects/3bf670dfebde4162b335b33c80afeffb/users/8efaf0eb944e4f0bac9a77bca9b68e26/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:48.122178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.122178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.122178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.122644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc65c2db73b440bbaedb2af51e6e2899, user_id=595a1bb3ec224b67885a0851dd540765, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.125642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.140892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 791/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:48 2022] PUT /identity/v3/projects/cc65c2db73b440bbaedb2af51e6e2899/users/595a1bb3ec224b67885a0851dd540765/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:48.141650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.147549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:48.151525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:48.177829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:48.202823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:48.211269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748ef4-40a6-40db-9d91-416993a7c988 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.217568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.218632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.219053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.219498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.231214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 814/1605] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:48.232090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.245614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc765e-2ed2-4633-ad8b-bb12e49d6482 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.251245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b2ee9-5dd0-4722-86d5-44044049c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.251907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2ee9-5dd0-4722-86d5-44044049c99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.252187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2ee9-5dd0-4722-86d5-44044049c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.252460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2ee9-5dd0-4722-86d5-44044049c99a admin admin] PATH_INFO: `/v3/projects/bbfda6078ea94d31971f231184bac96d/users/ce121c9623c24f36b39798694d509752/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.269196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b2ee9-5dd0-4722-86d5-44044049c99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfda6078ea94d31971f231184bac96d, user_id=ce121c9623c24f36b39798694d509752, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.272125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b2ee9-5dd0-4722-86d5-44044049c99a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.287178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 815/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:48 2022] PUT /identity/v3/projects/bbfda6078ea94d31971f231184bac96d/users/ce121c9623c24f36b39798694d509752/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:48.288496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c72b2e-dbae-41d9-b317-69a0d3a486bd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.288814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c72b2e-dbae-41d9-b317-69a0d3a486bd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.289073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c72b2e-dbae-41d9-b317-69a0d3a486bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.307709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.310273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.312203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a7c72b2e-dbae-41d9-b317-69a0d3a486bd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:48.313522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7c72b2e-dbae-41d9-b317-69a0d3a486bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:48.323969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 792/1607] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:48.325206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.335410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e1d4-c19a-4ba5-8ade-c89898e7e64f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.382858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 816/1608] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:48.387085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb64c-b8ed-4055-a09d-c822fc329226 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.387085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb64c-b8ed-4055-a09d-c822fc329226 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.387085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fb64c-b8ed-4055-a09d-c822fc329226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.408112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.408990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.409346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.410101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] PATH_INFO: `/v3/projects/0a2423f2abe043a889de9a476538ddf9/users/4cc1beb2c8174f2caeb41a76982bf4fc/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.418307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ce8fb64c-b8ed-4055-a09d-c822fc329226 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:48.419695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ce8fb64c-b8ed-4055-a09d-c822fc329226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:48.431409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2423f2abe043a889de9a476538ddf9, user_id=4cc1beb2c8174f2caeb41a76982bf4fc, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.431732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 817/1609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:48.432891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549f09b-3049-4536-af61-5cb9c3944a2f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.433173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549f09b-3049-4536-af61-5cb9c3944a2f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.433442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549f09b-3049-4536-af61-5cb9c3944a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.435470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.463811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 793/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:48 2022] PUT /identity/v3/projects/0a2423f2abe043a889de9a476538ddf9/users/4cc1beb2c8174f2caeb41a76982bf4fc/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:48.465444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.504278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c549f09b-3049-4536-af61-5cb9c3944a2f None None] MFA Rules not processed for user `595a1bb3ec224b67885a0851dd540765`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:48.507097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c549f09b-3049-4536-af61-5cb9c3944a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:48.541029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1958cdc-e1c7-4436-9609-abf491a0ea0c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.545711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.546635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.547281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.547281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.561750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:48.641462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 818/1611] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:48.642622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7af4e-dbc2-4701-bdb0-cbc7d6699baa None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.642903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7af4e-dbc2-4701-bdb0-cbc7d6699baa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.643178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7af4e-dbc2-4701-bdb0-cbc7d6699baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.658680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.661290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.674370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 794/1612] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:48.675410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-08a7af4e-dbc2-4701-bdb0-cbc7d6699baa None None] MFA Rules not processed for user `ce121c9623c24f36b39798694d509752`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:48.675909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.676625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-08a7af4e-dbc2-4701-bdb0-cbc7d6699baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:48.686919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671eda8-78e0-405f-9541-d5da4c87cfb3 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.693187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.708614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.709702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.710941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.718234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:48.736208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.739285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.767790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 795/1613] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:48.768768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.775870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 819/1614] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:48.777443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.778046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.778428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.783403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83473875-f979-4097-86bc-97466ccfe498 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.789667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.791038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.791391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.791724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.805712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:48.808400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:48.813274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.814950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.819959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 820/1615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:48.821958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.829913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 796/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:48.831712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.836062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf819ba9-b4bd-44be-984e-6c51a9fb8c90 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.843948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.844909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.845073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc402a7-f665-4f69-8a54-6fcec34f90b7 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:48.845518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.845935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.846774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.849711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.852173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:48.853060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:48.853653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:48.854109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:48.854975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:48.857724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:48.891155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 821/1617] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:48.895858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:48.896326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 797/1618] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:48.900658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.005414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f94e9-82d8-47f6-895c-1e8874b5f9ff admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.018508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.019402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.019678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.019944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.021035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1edaf1-c1b9-43fa-92fe-e622a5a96f09 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.021415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.028151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.043093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.043901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.044262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.044599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.045337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.047474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.066739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 822/1619] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:49.067627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.083333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 798/1620] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:48 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:49.084921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.099741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d23b2-ec19-40a1-9975-c5609072772d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.114355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.117450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.118985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.121141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.121939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.125440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.172495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 799/1621] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:49.176448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.199624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0655-3e34-4a4f-af12-ac13a4570d5f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.204966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.205726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.206132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.206580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.207245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.208912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.231228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 800/1622] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:49.233030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.239864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66903da5-522e-4fef-9b51-32e6e32fcc02 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.245144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949cc68-cae2-4dc6-9597-9c69bd99284c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.251347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.251554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.252130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.252252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.252524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.252636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.252889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] PATH_INFO: `/v3/projects/0eee377a77ed47a29414aacfef3be2d5/users/46ad5661590f420da557ba4d03f0ab51/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.253002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.276569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eee377a77ed47a29414aacfef3be2d5, user_id=46ad5661590f420da557ba4d03f0ab51, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.279669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.279811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.284869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.306211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 801/1623] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:49 2022] PUT /identity/v3/projects/0eee377a77ed47a29414aacfef3be2d5/users/46ad5661590f420da557ba4d03f0ab51/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:49.306211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.308457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 823/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:49.309256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.315600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:49.327018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e22293-d01e-4f85-bceb-39281c54429b service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.397310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:49.408364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66734e-d079-4c36-b27c-06e1635a7947 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.415581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.416327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.416626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.417189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] PATH_INFO: `/v3/projects/1af58d5f5f4148a0a9bbdc9d5af2aa12/users/3aa75ff4e06a4dcc8675bef88350c6ee/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.438163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af58d5f5f4148a0a9bbdc9d5af2aa12, user_id=3aa75ff4e06a4dcc8675bef88350c6ee, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.443028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.453061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.453992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.454253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.454520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.455167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.456847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.474799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 802/1625] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:49 2022] PUT /identity/v3/projects/1af58d5f5f4148a0a9bbdc9d5af2aa12/users/3aa75ff4e06a4dcc8675bef88350c6ee/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:49.476280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.488042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 824/1626] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:49.489111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.510724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d779-e101-4975-b18f-4ee4f4ea5f70 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.572082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfbbc6-8905-46c9-aeb1-4f29d9812c8e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.582825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.583746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.584209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.584959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.587271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.590101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.611253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 803/1627] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:49.613611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:49.647816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a948816-92d7-4062-a6c9-34fcdce4d41d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:49.649014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a93dd-238d-4714-852c-f499ee887f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.652076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a93dd-238d-4714-852c-f499ee887f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.652076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a93dd-238d-4714-852c-f499ee887f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.653844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a93dd-238d-4714-852c-f499ee887f14 admin admin] PATH_INFO: `/v3/projects/0eee377a77ed47a29414aacfef3be2d5/users/46ad5661590f420da557ba4d03f0ab51/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.657828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a93dd-238d-4714-852c-f499ee887f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eee377a77ed47a29414aacfef3be2d5, user_id=46ad5661590f420da557ba4d03f0ab51, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.660547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12be6bb-58d1-4ff0-90db-9e6c48bc4a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:49.661934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12be6bb-58d1-4ff0-90db-9e6c48bc4a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.663000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12be6bb-58d1-4ff0-90db-9e6c48bc4a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.665088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12be6bb-58d1-4ff0-90db-9e6c48bc4a86 admin admin] PATH_INFO: `/v3/projects/1af58d5f5f4148a0a9bbdc9d5af2aa12/users/3aa75ff4e06a4dcc8675bef88350c6ee/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.666577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a93dd-238d-4714-852c-f499ee887f14 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.668661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12be6bb-58d1-4ff0-90db-9e6c48bc4a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af58d5f5f4148a0a9bbdc9d5af2aa12, user_id=3aa75ff4e06a4dcc8675bef88350c6ee, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:49.676647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12be6bb-58d1-4ff0-90db-9e6c48bc4a86 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:49.722105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 825/1628] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:49 2022] PUT /identity/v3/projects/0eee377a77ed47a29414aacfef3be2d5/users/46ad5661590f420da557ba4d03f0ab51/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:22:49.725839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.727946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.728455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.749063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 804/1629] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:49 2022] PUT /identity/v3/projects/1af58d5f5f4148a0a9bbdc9d5af2aa12/users/3aa75ff4e06a4dcc8675bef88350c6ee/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:49.751221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:49.753920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:49.755361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:49.827892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] MFA Rules not processed for user `46ad5661590f420da557ba4d03f0ab51`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:49.829097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:49.831742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] MFA Rules not processed for user `3aa75ff4e06a4dcc8675bef88350c6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:49.833171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:50.040015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:50.046393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 826/1630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:50.061799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:50.074002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 805/1631] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:50.095062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:50.199550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a4b78-5aab-40a6-aafc-bfb2eda1f09e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:50.204203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c21ca4-454c-4396-84b1-aaea851bf5fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:50.205296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21ca4-454c-4396-84b1-aaea851bf5fd service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:50.205579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21ca4-454c-4396-84b1-aaea851bf5fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:50.205847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21ca4-454c-4396-84b1-aaea851bf5fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:50.212633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:50.221658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da377a5-0449-4ab2-8d22-5850b2b336d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:50.226672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:50.228368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:50.228855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:50.229275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:50.245530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:50.247749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:50.288534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 806/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:50.339302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c21ca4-454c-4396-84b1-aaea851bf5fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:50.343749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c21ca4-454c-4396-84b1-aaea851bf5fd service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:50.409039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 827/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:50.570290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:50.590945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c4e31-67d3-40b5-bf51-3c9495420510 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:50.598294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:50.598914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:50.599187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:50.599452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:50.715643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:50.717656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:50.737255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 807/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:22:53.440145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:53.441823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:53.442280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:53.479912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] MFA Rules not processed for user `4cc1beb2c8174f2caeb41a76982bf4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:22:53.483071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:22:53.615605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 828/1635] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:22:53.621132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:53.777535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fe211-3144-4ce9-9cc3-bbf625f2c7de service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:53.792886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:53.794601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:53.795341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:53.797838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:53.798637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:53.803913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:53.891508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 808/1636] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:22:53 2022] POST /identity/v3/projects => generated 405 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:53.895542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:53.915558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ec71a-765e-446f-b52a-3cbe23c78879 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:54.059386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:54.060010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:54.060313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:54.060561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:54.061360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:54.063970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:54.123678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 829/1637] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:22:53 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:22:54.125175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:54.138043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781a7ff-f54c-46bc-a6f1-55d79fcec962 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:54.154502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:54.155147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:54.155439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:54.155708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:54.156364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:54.158451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:54.202037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 809/1638] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:54.204041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:54.219973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4bb2-aa56-4e6f-a8a2-031b6203745a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:54.233762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:54.238901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:54.241372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:54.241853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] PATH_INFO: `/v3/projects/7e0d76121b8349b98f43556bf7c51023/users/dba47ba93e494fa894e139aa3958aa95/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:54.249272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:54.259709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:54.297625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0d76121b8349b98f43556bf7c51023, user_id=dba47ba93e494fa894e139aa3958aa95, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:54.301841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:54.338447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:54.349754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 830/1639] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:54 2022] PUT /identity/v3/projects/7e0d76121b8349b98f43556bf7c51023/users/dba47ba93e494fa894e139aa3958aa95/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:54.351473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:54.403450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8d963-7fc5-4ff0-bc00-4abb78b2dda3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:54.547033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903183-d01d-4f4a-8982-d3a99ad6444b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:54.547654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903183-d01d-4f4a-8982-d3a99ad6444b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:54.548942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903183-d01d-4f4a-8982-d3a99ad6444b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:54.549340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903183-d01d-4f4a-8982-d3a99ad6444b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:54.576156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb914-9c99-4ca8-a443-59ec3e025e0d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:54.593038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:54.594380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:54.594988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:54.595325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:54.596059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:54.600204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:54.636518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 831/1640] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:22:54.641332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:22:54.661691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648431d-cc63-414e-add1-4ebf5034713d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:22:54.674341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903183-d01d-4f4a-8982-d3a99ad6444b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:54.677747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:22:54.678324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903183-d01d-4f4a-8982-d3a99ad6444b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:54.678641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:22:54.679025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:22:54.681943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] PATH_INFO: `/v3/projects/7e0d76121b8349b98f43556bf7c51023/users/dba47ba93e494fa894e139aa3958aa95/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:22:54.688704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0d76121b8349b98f43556bf7c51023, user_id=dba47ba93e494fa894e139aa3958aa95, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:22:54.694189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:22:54.738220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 832/1641] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:22:54 2022] PUT /identity/v3/projects/7e0d76121b8349b98f43556bf7c51023/users/dba47ba93e494fa894e139aa3958aa95/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:22:54.752985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 810/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:22:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:00.466204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:00.656741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:00.657273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:00.657273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:00.693824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d54fe-d635-456e-98a2-00469ba15e65 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:00.706618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:00.707464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:00.707888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:00.708326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] PATH_INFO: `/v3/users/ce121c9623c24f36b39798694d509752` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:00.714859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce121c9623c24f36b39798694d509752)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:00.717090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:00.754575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] MFA Rules not processed for user `dba47ba93e494fa894e139aa3958aa95`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:00.758696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:00.866916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce121c9623c24f36b39798694d509752'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:00.869164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce121c9623c24f36b39798694d509752'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:00.873500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce121c9623c24f36b39798694d509752'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:00.887549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce121c9623c24f36b39798694d509752'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:00.911739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-584d245f-703d-4bfa-80a3-ed289176d2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce121c9623c24f36b39798694d509752'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:01.016649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:01.018392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 833/1643] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:00 2022] DELETE /identity/v3/users/ce121c9623c24f36b39798694d509752 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:01.030877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cee35-656b-4005-a219-2143349b14de None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:01.031233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cee35-656b-4005-a219-2143349b14de None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:01.031510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cee35-656b-4005-a219-2143349b14de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:01.044478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 811/1644] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:01.072263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:01.124162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ed9cee35-656b-4005-a219-2143349b14de None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:01.125442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ed9cee35-656b-4005-a219-2143349b14de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:01.314375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 834/1645] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:01.346341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:01.347905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:01.481748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bd89b-1dfc-45bf-aff9-b21006dbb2f7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:01.559693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae998e-e67e-4073-ac1a-04b642046528 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:01.560160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae998e-e67e-4073-ac1a-04b642046528 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:01.560243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae998e-e67e-4073-ac1a-04b642046528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:01.663461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c738b2-25b1-47db-b31a-d9970be9925d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:01.664978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-15ae998e-e67e-4073-ac1a-04b642046528 None None] MFA Rules not processed for user `c0c517b3f34d440ca41ce746c175319f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:01.666377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-15ae998e-e67e-4073-ac1a-04b642046528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:01.667212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c738b2-25b1-47db-b31a-d9970be9925d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:01.668480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c738b2-25b1-47db-b31a-d9970be9925d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:01.669010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c738b2-25b1-47db-b31a-d9970be9925d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:01.702583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c738b2-25b1-47db-b31a-d9970be9925d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:01.704991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c738b2-25b1-47db-b31a-d9970be9925d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:01.736826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 812/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:01.842292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 835/1647] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:01.853694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674ecf-152b-4245-b16d-a4fe7bd93063 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:01.853985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674ecf-152b-4245-b16d-a4fe7bd93063 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:01.854264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef674ecf-152b-4245-b16d-a4fe7bd93063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:01.901351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ef674ecf-152b-4245-b16d-a4fe7bd93063 None None] MFA Rules not processed for user `c0c517b3f34d440ca41ce746c175319f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:01.902576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef674ecf-152b-4245-b16d-a4fe7bd93063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:01.928048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 813/1648] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:01.995358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3291d4c-e77f-435a-945a-1ba137e7c9d2 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:01.995645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3291d4c-e77f-435a-945a-1ba137e7c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:01.995916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3291d4c-e77f-435a-945a-1ba137e7c9d2 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:01.997603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 836/1649] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 28 12:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:02.015214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d54c52-3190-49cd-910a-0210a7af93cc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:02.015821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d54c52-3190-49cd-910a-0210a7af93cc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:02.015972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d54c52-3190-49cd-910a-0210a7af93cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:02.115872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-93d54c52-3190-49cd-910a-0210a7af93cc None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:02.121137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-93d54c52-3190-49cd-910a-0210a7af93cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:02.309986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 814/1650] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 28 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:02.319974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3291d4c-e77f-435a-945a-1ba137e7c9d2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:02.347117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3291d4c-e77f-435a-945a-1ba137e7c9d2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:02.361930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f3c5b-f68f-4ced-b7b7-806f1c316915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:02.362506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3c5b-f68f-4ced-b7b7-806f1c316915 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:02.362783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3c5b-f68f-4ced-b7b7-806f1c316915 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:02.363615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3c5b-f68f-4ced-b7b7-806f1c316915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:02.384453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f3c5b-f68f-4ced-b7b7-806f1c316915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:02.386133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f3c5b-f68f-4ced-b7b7-806f1c316915 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:02.411758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 837/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:02.727505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513354d-0db3-45c7-8431-57a4fe71c3b8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:02.728606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513354d-0db3-45c7-8431-57a4fe71c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:02.729119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513354d-0db3-45c7-8431-57a4fe71c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:02.810924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0513354d-0db3-45c7-8431-57a4fe71c3b8 None None] MFA Rules not processed for user `778f3756020548dda6e0162f5560a328`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:02.812988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0513354d-0db3-45c7-8431-57a4fe71c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:02.867172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:02.987664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 815/1652] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:03.002114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0ab8-3650-4dc8-8cc0-80d5197c3d1d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.002588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0ab8-3650-4dc8-8cc0-80d5197c3d1d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.002694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0ab8-3650-4dc8-8cc0-80d5197c3d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.049994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f66e0ab8-3650-4dc8-8cc0-80d5197c3d1d None None] MFA Rules not processed for user `778f3756020548dda6e0162f5560a328`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:03.051044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f66e0ab8-3650-4dc8-8cc0-80d5197c3d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.084874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 838/1653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:03.128620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f730-3946-4527-a5c2-23b4bd2946dc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.129271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f730-3946-4527-a5c2-23b4bd2946dc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.130142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f730-3946-4527-a5c2-23b4bd2946dc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.131556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 816/1654] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 28 12:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:03.163992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f27da-4b69-4436-a965-c47c4833d307 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.164839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f27da-4b69-4436-a965-c47c4833d307 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.166663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.167039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.167203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.169224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f27da-4b69-4436-a965-c47c4833d307 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.172157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 839/1655] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 28 12:23:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:03.179707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.179707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.179707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.233125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:03.238236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.261926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:03.266152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.284285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 817/1656] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 28 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:03.287288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:03.293257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.298743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 840/1657] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:03.299593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:03.335685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8669-72c3-44b3-8728-f5d8e9ebb88a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:03.338274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd34ad-eed7-4128-9fee-90b65854d080 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:03.349514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:03.350175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.350452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.350722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] PATH_INFO: `/v3/projects/bbfda6078ea94d31971f231184bac96d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.359074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfda6078ea94d31971f231184bac96d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:03.362655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:03.364126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:03.364754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.365052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.365319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.392100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:03.395107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:03.428210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 841/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:03.429097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:03.431076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.510097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfda6078ea94d31971f231184bac96d', 'request_id': 'req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.538361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfda6078ea94d31971f231184bac96d', 'request_id': 'req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.553061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfda6078ea94d31971f231184bac96d', 'request_id': 'req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.592540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] The token cache is being invalidate because project bbfda6078ea94d31971f231184bac96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:03.592890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.596598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.601420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 818/1659] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:03 2022] DELETE /identity/v3/projects/bbfda6078ea94d31971f231184bac96d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:03.609483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:03.610448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.635423 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:03.708286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f172-406a-4291-93ee-3a3edb851f4a service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:03.798588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc005916-ec96-4ac9-a4b8-9e13ba9fa595 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:03.808865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:03.809516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.810278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.811727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] PATH_INFO: `/v3/users/3aa75ff4e06a4dcc8675bef88350c6ee` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.817794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa75ff4e06a4dcc8675bef88350c6ee)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:03.821161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:23:03.821161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 28 12:23:03.821161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: Sep 28 12:23:03.823991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:03.834652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:03.835281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:03.835558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:03.835825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:03.847993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:03.939749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:03.958793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa75ff4e06a4dcc8675bef88350c6ee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.983004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa75ff4e06a4dcc8675bef88350c6ee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.983787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa75ff4e06a4dcc8675bef88350c6ee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:03.984551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa75ff4e06a4dcc8675bef88350c6ee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:04.006716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef37cd23-ba16-4bbc-af6a-a2d6c542bdd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa75ff4e06a4dcc8675bef88350c6ee'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:04.050470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 819/1660] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:03 2022] DELETE /identity/v3/users/3aa75ff4e06a4dcc8675bef88350c6ee => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:04.062276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:04.063910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad19bc-1f91-4ac5-aca7-f6aa20165ee4 service glance] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:04.088534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 842/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:04.182843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a95c1-0314-440b-b562-db8b455e34d1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:04.183211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a95c1-0314-440b-b562-db8b455e34d1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:04.183557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a95c1-0314-440b-b562-db8b455e34d1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:04.185208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 820/1662] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 28 12:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:04.191050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19740-81e5-4a16-b3ab-2ace0e1912b0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:04.191337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19740-81e5-4a16-b3ab-2ace0e1912b0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:04.191611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19740-81e5-4a16-b3ab-2ace0e1912b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:04.228415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-40c19740-81e5-4a16-b3ab-2ace0e1912b0 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:04.229670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-40c19740-81e5-4a16-b3ab-2ace0e1912b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:04.348920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 843/1663] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:04.368734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a95c1-0314-440b-b562-db8b455e34d1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:04.371144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-657a95c1-0314-440b-b562-db8b455e34d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:04.562932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a95c1-0314-440b-b562-db8b455e34d1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:04.567481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ed615-0425-4a29-be53-2ffd76150e99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:04.569055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed615-0425-4a29-be53-2ffd76150e99 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:04.570034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed615-0425-4a29-be53-2ffd76150e99 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:04.570676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed615-0425-4a29-be53-2ffd76150e99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:04.595741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ed615-0425-4a29-be53-2ffd76150e99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:04.598283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ed615-0425-4a29-be53-2ffd76150e99 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:04.630683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 821/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:04.770111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774077cc-29e1-46dd-bab6-d3d1646db87a None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:04.770246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774077cc-29e1-46dd-bab6-d3d1646db87a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:04.771186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774077cc-29e1-46dd-bab6-d3d1646db87a None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:04.773103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 844/1665] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:04.835616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7d7a-b10f-4f96-a334-9836bcf11a8f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:04.836685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7d7a-b10f-4f96-a334-9836bcf11a8f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:04.837206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7d7a-b10f-4f96-a334-9836bcf11a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:04.892204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f50f7d7a-b10f-4f96-a334-9836bcf11a8f None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:04.895924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f50f7d7a-b10f-4f96-a334-9836bcf11a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:05.066022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 822/1666] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:05.153928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774077cc-29e1-46dd-bab6-d3d1646db87a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:05.156474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-774077cc-29e1-46dd-bab6-d3d1646db87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:05.212027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774077cc-29e1-46dd-bab6-d3d1646db87a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:05.230829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4acb-5820-4a22-baaf-7f64854216ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:05.231686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4acb-5820-4a22-baaf-7f64854216ff service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:05.232097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4acb-5820-4a22-baaf-7f64854216ff service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:05.232638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4acb-5820-4a22-baaf-7f64854216ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:05.256938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc4acb-5820-4a22-baaf-7f64854216ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:05.259280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc4acb-5820-4a22-baaf-7f64854216ff service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:05.293539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 845/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:05.834257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558b6a-99f1-4399-a897-75332847bc81 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:05.834777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558b6a-99f1-4399-a897-75332847bc81 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:05.835208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558b6a-99f1-4399-a897-75332847bc81 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:05.837587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 823/1668] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 28 12:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:23:05.845643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:05.846178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:05.847436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:05.913461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:05.979807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118ed4-1e2f-4ced-9cdd-1af872bc31cf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:05.980189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118ed4-1e2f-4ced-9cdd-1af872bc31cf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:05.980347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:05.980593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66118ed4-1e2f-4ced-9cdd-1af872bc31cf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:05.982010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:05.982653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 824/1669] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 28 12:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:05.996988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:05.997372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:05.997722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:06.061699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:06.062929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:06.188005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 846/1670] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:06.271837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 825/1671] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:06.327011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:06.329189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:06.350537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a8bf9-44a5-4da1-a322-1434c313763b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:06.366741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:06.367948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:06.368506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:06.369327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:06.396249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:06.400708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:06.412643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:06.424548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:06.425712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:06.432447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbeda7-654e-45ff-9ef4-238ac602382d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:06.440714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abdc95-76b5-4f83-92b2-68075a075c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:06.441473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abdc95-76b5-4f83-92b2-68075a075c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:06.442160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abdc95-76b5-4f83-92b2-68075a075c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:06.442160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abdc95-76b5-4f83-92b2-68075a075c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:06.449384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 847/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:06.457852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abdc95-76b5-4f83-92b2-68075a075c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:06.460117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abdc95-76b5-4f83-92b2-68075a075c3a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:06.480569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 826/1673] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:07.063307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:07.065007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:07.246842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c8e0-458d-4ddf-828c-139f4c5328f6 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:07.259673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:07.260711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:07.261157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:07.261569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] PATH_INFO: `/v3/projects/1af58d5f5f4148a0a9bbdc9d5af2aa12` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:07.262972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af58d5f5f4148a0a9bbdc9d5af2aa12)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:07.264187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: WARNING py.warnings [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 12:23:07.264187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: warnings.warn(msg) Sep 28 12:23:07.264187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: Sep 28 12:23:07.265810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:07.397728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af58d5f5f4148a0a9bbdc9d5af2aa12', 'request_id': 'req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:07.428442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af58d5f5f4148a0a9bbdc9d5af2aa12', 'request_id': 'req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:07.455571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af58d5f5f4148a0a9bbdc9d5af2aa12', 'request_id': 'req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:07.472327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] The token cache is being invalidate because project 1af58d5f5f4148a0a9bbdc9d5af2aa12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:07.472626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:07.473312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:07.478882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 848/1674] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:07 2022] DELETE /identity/v3/projects/1af58d5f5f4148a0a9bbdc9d5af2aa12 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:07.480641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc35242-b74c-4d4c-b1f4-faacd4c918cd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:07.481107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc35242-b74c-4d4c-b1f4-faacd4c918cd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:07.481307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc35242-b74c-4d4c-b1f4-faacd4c918cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:07.517374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1bc35242-b74c-4d4c-b1f4-faacd4c918cd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:07.519089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1bc35242-b74c-4d4c-b1f4-faacd4c918cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:07.656068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:07.658569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:07.718441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 827/1675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:07.729570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:07.729965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:07.730300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:07.755650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:07.767849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:07.769754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:07.801732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 828/1676] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:07.803290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:07.853979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40b6b-6a6e-4cf7-b66d-623fc058f107 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:07.899206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:07.900266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:07.901834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:07.902321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:07.908554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:07.908896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:07.918590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:07.935822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5a24-9bb8-4475-9d96-c23c09f0c4d7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:07.950986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 829/1677] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:07.954999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:07.956406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:07.957519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:07.957641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:07.958262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:07.958821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] PATH_INFO: `/v3/users/4cc1beb2c8174f2caeb41a76982bf4fc` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:07.962623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc1beb2c8174f2caeb41a76982bf4fc)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:07.966022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:08.108434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc1beb2c8174f2caeb41a76982bf4fc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:08.109538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc1beb2c8174f2caeb41a76982bf4fc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:08.110386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc1beb2c8174f2caeb41a76982bf4fc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:08.128744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc1beb2c8174f2caeb41a76982bf4fc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:08.154679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc1beb2c8174f2caeb41a76982bf4fc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:08.203924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 849/1678] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:07 2022] DELETE /identity/v3/users/4cc1beb2c8174f2caeb41a76982bf4fc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:08.205114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:08.206915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:08.224552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d039-f73b-4f92-95f2-ebdea2270886 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:08.489883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:08.492644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:08.494302 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:08.495489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:08.501252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:08.533457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:08.539975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c06af2-2365-44d8-b2ae-4c081b0597bf service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:08.570601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 830/1679] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:08.572427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55dfde-2a98-403e-8c2f-c318b78eb674 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:08.574999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55dfde-2a98-403e-8c2f-c318b78eb674 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:08.575870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55dfde-2a98-403e-8c2f-c318b78eb674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:08.583156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7add0d-7ba8-4558-939c-d3a1cd388e71 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:08.597836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:08.606327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95890-8126-47a7-865b-2ff377c5ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:08.606959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95890-8126-47a7-865b-2ff377c5ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:08.607238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95890-8126-47a7-865b-2ff377c5ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:08.607510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95890-8126-47a7-865b-2ff377c5ab94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:08.608149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95890-8126-47a7-865b-2ff377c5ab94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:08.635080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cc55dfde-2a98-403e-8c2f-c318b78eb674 None None] MFA Rules not processed for user `778f3756020548dda6e0162f5560a328`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:08.638380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95890-8126-47a7-865b-2ff377c5ab94 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:08.640954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc55dfde-2a98-403e-8c2f-c318b78eb674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:08.705365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 850/1680] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:08 2022] POST /identity/v3/projects => generated 379 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:08.707306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8c1f1-1403-460c-906b-9fcf9410e289 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:08.709603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8c1f1-1403-460c-906b-9fcf9410e289 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:08.712849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8c1f1-1403-460c-906b-9fcf9410e289 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:08.715271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 851/1681] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 28 12:23:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:08.718333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8c1f1-1403-460c-906b-9fcf9410e289 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:08.812712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:08.933093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 831/1682] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:08.934631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:08.935509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:08.935885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:08.947511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8c1f1-1403-460c-906b-9fcf9410e289 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:08.958715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:08.959280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:08.959551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:08.960196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:08.960591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:08.963776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.019721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 852/1683] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:08 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:09.021292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:09.029167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:09.036108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.043684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.087040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c5e79-16d5-4519-a20b-68bf7b6fda55 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:09.096296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:09.096986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.097305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.097575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] PATH_INFO: `/v3/projects/0a2423f2abe043a889de9a476538ddf9` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:09.099362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2423f2abe043a889de9a476538ddf9)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:09.101871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.191432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 832/1684] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 28 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:09.192505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:09.205811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2423f2abe043a889de9a476538ddf9', 'request_id': 'req-673384e0-a95d-4a68-ad84-346005243299'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.207779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfd25b-a276-4f44-9493-c3cced07c55d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:09.219669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2423f2abe043a889de9a476538ddf9', 'request_id': 'req-673384e0-a95d-4a68-ad84-346005243299'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.234465 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2423f2abe043a889de9a476538ddf9', 'request_id': 'req-673384e0-a95d-4a68-ad84-346005243299'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.260555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] The token cache is being invalidate because project 0a2423f2abe043a889de9a476538ddf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:09.261096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.261852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.271538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 853/1685] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:09 2022] DELETE /identity/v3/projects/0a2423f2abe043a889de9a476538ddf9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:09.272622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:09.276325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.385722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:09.386838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.387374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.387860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:09.389356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:09.393659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.402676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673384e0-a95d-4a68-ad84-346005243299 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:09.409392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:09.410190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.410471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.410744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:09.412560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 833/1686] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:09.414752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:09.416844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.421623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.437008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e4959-ad36-448b-ae0e-1e3b801daa72 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:09.445577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:09.447623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:09.447835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.449145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.449542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.450651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] PATH_INFO: `/v3/users/dba47ba93e494fa894e139aa3958aa95` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:09.452143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba47ba93e494fa894e139aa3958aa95)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:09.455153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.530237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 854/1687] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:09.536555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:09.539622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:09.542735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.561575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba47ba93e494fa894e139aa3958aa95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.579885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba47ba93e494fa894e139aa3958aa95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.584067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba47ba93e494fa894e139aa3958aa95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.588429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba47ba93e494fa894e139aa3958aa95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.607082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff50a8-5459-4394-bbb8-cad47fd2da10 service placement] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:09.608142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba47ba93e494fa894e139aa3958aa95'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:09.638599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7ba0-a027-4b0d-987f-30e1e7ea8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:09.639232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7ba0-a027-4b0d-987f-30e1e7ea8e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.639516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7ba0-a027-4b0d-987f-30e1e7ea8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.640208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7ba0-a027-4b0d-987f-30e1e7ea8e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:09.654240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7ba0-a027-4b0d-987f-30e1e7ea8e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:09.662723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7ba0-a027-4b0d-987f-30e1e7ea8e05 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.676603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 834/1688] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:09 2022] DELETE /identity/v3/users/dba47ba93e494fa894e139aa3958aa95 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:09.717694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:09.717915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 855/1689] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:09.719570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:09.920461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85ff2-82ff-40df-8c31-ff7ecb2286c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:09.928183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:09.929242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.929469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.930646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] PATH_INFO: `/v3/projects/85f813122af147b6a3fba00b85eb988a/users/fe14648bce904f4e81cb88deb1cd690f/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:09.950217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f813122af147b6a3fba00b85eb988a, user_id=fe14648bce904f4e81cb88deb1cd690f, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:09.954442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:09.975591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 835/1690] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:09 2022] PUT /identity/v3/projects/85f813122af147b6a3fba00b85eb988a/users/fe14648bce904f4e81cb88deb1cd690f/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:09.992969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:09.993226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:09.993613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:10.069066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] MFA Rules not processed for user `fe14648bce904f4e81cb88deb1cd690f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:10.071170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:10.080254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:10.250196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 856/1691] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:10.254210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:10.462587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6c6a8-8630-4714-ae57-73e3eaa57f95 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:10.480725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:10.481644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:10.481951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:10.482190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:10.482845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:10.484765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:10.592238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:10.615884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 836/1692] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:10 2022] POST /identity/v3/projects => generated 381 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:10.622920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb281d-8fc3-462c-81d9-89be0c03a030 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:10.682996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:10.685675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:10.795319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:10.835126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596136-4971-4983-a7b8-aafeace9d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:10.836409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596136-4971-4983-a7b8-aafeace9d52c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:10.836927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596136-4971-4983-a7b8-aafeace9d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:10.837345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596136-4971-4983-a7b8-aafeace9d52c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:10.838144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36596136-4971-4983-a7b8-aafeace9d52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:10.842314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36596136-4971-4983-a7b8-aafeace9d52c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:10.888766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd954-cffc-408e-ab40-e5bb257f5cb2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:10.901197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:10.902232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:10.902320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:10.902588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] PATH_INFO: `/v3/projects/7e0d76121b8349b98f43556bf7c51023` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:10.904608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0d76121b8349b98f43556bf7c51023)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:10.905691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 857/1693] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:10 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:10.908869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:10.909159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:10.909439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:10.910426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:11.000301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] MFA Rules not processed for user `6ebfeba30aa342a99e0d5855f9ac8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:11.004983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.025707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0d76121b8349b98f43556bf7c51023', 'request_id': 'req-14e65b05-b508-4c54-9c9f-c09218791785'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.043997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0d76121b8349b98f43556bf7c51023', 'request_id': 'req-14e65b05-b508-4c54-9c9f-c09218791785'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.077309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0d76121b8349b98f43556bf7c51023', 'request_id': 'req-14e65b05-b508-4c54-9c9f-c09218791785'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.117370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] The token cache is being invalidate because project 7e0d76121b8349b98f43556bf7c51023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:11.117810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.118810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.125981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 837/1694] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:10 2022] DELETE /identity/v3/projects/7e0d76121b8349b98f43556bf7c51023 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:11.127726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:11.136184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.196993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 858/1695] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:11.196993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:11.198885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.299492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:11.370568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65b05-b508-4c54-9c9f-c09218791785 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:11.415331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4eb3ae-79e1-42e4-88e7-10deb177f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:11.416004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eb3ae-79e1-42e4-88e7-10deb177f7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:11.416290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eb3ae-79e1-42e4-88e7-10deb177f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:11.416568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eb3ae-79e1-42e4-88e7-10deb177f7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:11.417259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4eb3ae-79e1-42e4-88e7-10deb177f7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:11.424183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4eb3ae-79e1-42e4-88e7-10deb177f7b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:11.434641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c9e3-91e3-49b0-aac8-de5bc7ee0952 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:11.446303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:11.447511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:11.447791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:11.448060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] PATH_INFO: `/v3/users/595a1bb3ec224b67885a0851dd540765` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:11.450588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595a1bb3ec224b67885a0851dd540765)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:11.452892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:11.456324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 838/1696] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:11.458072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4466e-afcc-41b4-b11e-fa6a2e78cf10 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:11.458072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4466e-afcc-41b4-b11e-fa6a2e78cf10 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:11.458379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4466e-afcc-41b4-b11e-fa6a2e78cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:11.520184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-39b4466e-afcc-41b4-b11e-fa6a2e78cf10 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:11.522473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39b4466e-afcc-41b4-b11e-fa6a2e78cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.565497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 839/1697] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:11.569359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:11.571056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:11.571928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:11.585078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595a1bb3ec224b67885a0851dd540765'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.588123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595a1bb3ec224b67885a0851dd540765'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.602475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595a1bb3ec224b67885a0851dd540765'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.619850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595a1bb3ec224b67885a0851dd540765'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.645394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595a1bb3ec224b67885a0851dd540765'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:11.671560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] MFA Rules not processed for user `8efaf0eb944e4f0bac9a77bca9b68e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:11.673508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.715364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:11.733713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 859/1698] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:11 2022] DELETE /identity/v3/users/595a1bb3ec224b67885a0851dd540765 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:11.734997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:11.739932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.815399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 840/1699] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:11.825266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:11.825266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.834924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068536f8-3a68-4c05-bcee-5ce5274a7a2e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:11.954102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bee49-5cfa-4f75-80a6-a94d74c71107 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:11.968164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:11.968972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:11.969312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:11.969944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:11.971874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:11.982850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1b36-209f-4b56-87cc-0868947b6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:11.984828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1b36-209f-4b56-87cc-0868947b6163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:11.985247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1b36-209f-4b56-87cc-0868947b6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:11.985751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1b36-209f-4b56-87cc-0868947b6163 admin admin] PATH_INFO: `/v3/projects/77a82568edfc4913bf40b7c60d57922e/users/a9f34bba2d1b4ad795d22164b3e4f27e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.004185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1b36-209f-4b56-87cc-0868947b6163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a82568edfc4913bf40b7c60d57922e, user_id=a9f34bba2d1b4ad795d22164b3e4f27e, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:12.008416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1b36-209f-4b56-87cc-0868947b6163 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:12.037562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 841/1700] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:11 2022] PUT /identity/v3/projects/77a82568edfc4913bf40b7c60d57922e/users/a9f34bba2d1b4ad795d22164b3e4f27e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:12.040445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51c18-6450-4d4a-8995-59648028baaf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:12.040896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51c18-6450-4d4a-8995-59648028baaf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:12.041361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51c18-6450-4d4a-8995-59648028baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.075012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:12.109334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bcb51c18-6450-4d4a-8995-59648028baaf None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:12.119423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bcb51c18-6450-4d4a-8995-59648028baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:12.129680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:12.131841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631431a8-ef3f-449d-aa21-dcbc9e6d4426 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:12.192165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 860/1701] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:12.196304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:12.196731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:12.197029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.239671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 842/1702] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:12.241709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:12.241709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:12.242695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.288381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] MFA Rules not processed for user `0c34731e291046cbb634305a95ead7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:12.290016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:12.315662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:12.318594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:12.365184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 843/1703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:12.369128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:12.374008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:12.560692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 861/1704] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:12.562582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:12.590952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:12.637802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3af6cf-8767-4c4b-985e-3190cc39b8af None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:12.671014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230f7f-af14-4669-90d2-7e495fe7c06e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:12.680927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:12.682658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:12.683501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:12.686770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.688872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:12.693457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:12.698214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:12.698991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:12.699272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:12.699539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.721879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 862/1705] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:12.722993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:12.755987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c3a3-61e0-4c9c-a23f-f1e048a2e27d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:12.779962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:12.781109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:12.781573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:12.782097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:12.783582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:12.785419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:12.792675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:12.848769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 863/1706] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:12.878445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:12.890231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:12.970851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:12.970851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:13.001271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 844/1707] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:13.002244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:13.060045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14986b-0cf6-4569-b836-561df6709d07 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:13.083588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:13.084270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:13.093877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:13.093877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] PATH_INFO: `/v3/projects/77a82568edfc4913bf40b7c60d57922e/users/a9f34bba2d1b4ad795d22164b3e4f27e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:13.106719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a82568edfc4913bf40b7c60d57922e, user_id=a9f34bba2d1b4ad795d22164b3e4f27e, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:13.109599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:13.197740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 845/1708] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:13 2022] PUT /identity/v3/projects/77a82568edfc4913bf40b7c60d57922e/users/a9f34bba2d1b4ad795d22164b3e4f27e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:13.197740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:13.281148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e2c3-ee3e-40fa-9ca1-50e1a2aaa5af admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:13.489569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30577-9249-4e66-8888-4db1a0ca056e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:13.490396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30577-9249-4e66-8888-4db1a0ca056e service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:13.490803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30577-9249-4e66-8888-4db1a0ca056e service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:13.491203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30577-9249-4e66-8888-4db1a0ca056e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:13.520008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493972e-38d1-4e44-84fd-b021bd68ac87 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:13.521010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30577-9249-4e66-8888-4db1a0ca056e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:13.527242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30577-9249-4e66-8888-4db1a0ca056e service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:13.544306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:13.545475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:13.545953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:13.546414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:13.548805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:13.555270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:13.565619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 864/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:13.567020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed03f1b-e63d-419a-83cd-adb01db50c23 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:13.576304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed03f1b-e63d-419a-83cd-adb01db50c23 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:13.576689 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed03f1b-e63d-419a-83cd-adb01db50c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:13.634139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 846/1710] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:13 2022] POST /identity/v3/projects => generated 399 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:13.636022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:13.637890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:13.655454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bed03f1b-e63d-419a-83cd-adb01db50c23 None None] MFA Rules not processed for user `a9f34bba2d1b4ad795d22164b3e4f27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:13.656922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bed03f1b-e63d-419a-83cd-adb01db50c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:13.853023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:13.880722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a6ce-5dde-4601-bac2-7cc553b91049 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:13.893814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:13.894453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:13.894813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:13.895292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:13.904467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 865/1711] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:13.912908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:13.913323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:13.913650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.038656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:14.043426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:14.076372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 847/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:14.080369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:14.108824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:14.111250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:14.273695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 866/1713] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:14.275713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:14.281069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:14.342976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e714347-ffa3-47db-a4fb-b8445efcd7ee service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:14.355586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:14.357371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:14.357645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:14.359229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.361009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:14.365640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:14.425812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 848/1714] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:14 2022] POST /identity/v3/users => generated 300 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:14.430859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:14.433811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd734-06b4-4629-bed2-9506ac5cd67d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:14.441461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:14.442332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:14.442704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:14.443066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.452943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33208eb-7f2d-43fc-86e9-fcb7deb49838 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:14.463175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:14.467106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:14.467397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:14.467674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.470549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:14.471454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:14.473432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:14.480223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:14.499589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 867/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:14.502905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 849/1716] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:14.504798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:14.528408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732d8cb-4ddf-4eca-9c56-5b684bf2ce19 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:14.542265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:14.542935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:14.543212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:14.543477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.544269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:14.545909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:14.548041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:14.568751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 868/1717] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:14.573312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:14.594603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf4517-b50b-493f-a032-6c964e4aad7c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:14.609124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5e42-fdce-45a8-b2e8-9afe756d1b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:14.609124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5e42-fdce-45a8-b2e8-9afe756d1b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:14.609124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5e42-fdce-45a8-b2e8-9afe756d1b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:14.609910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5e42-fdce-45a8-b2e8-9afe756d1b69 admin admin] PATH_INFO: `/v3/projects/e5ccb7374ba143bda886e61d6f684289/users/5ed4923aa3be4b66921b74c833677e81/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.629704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:14.631877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:14.717154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e5e42-fdce-45a8-b2e8-9afe756d1b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ccb7374ba143bda886e61d6f684289, user_id=5ed4923aa3be4b66921b74c833677e81, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:14.721666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e5e42-fdce-45a8-b2e8-9afe756d1b69 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:14.752414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 850/1718] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:14 2022] PUT /identity/v3/projects/e5ccb7374ba143bda886e61d6f684289/users/5ed4923aa3be4b66921b74c833677e81/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:14.766003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:14.766625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:14.766625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:14.843129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] MFA Rules not processed for user `5ed4923aa3be4b66921b74c833677e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:14.844450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:14.919480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bb92d-1fb5-4bfa-b087-7ae1274bc9ed admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:14.976923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:15.059823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 851/1719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:15.064048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:15.125695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:15.131180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:15.131687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:15.132014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:15.279278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225988-93df-45fc-8573-750d5e0d1bf3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:15.291370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:15.292294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:15.294013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:15.294384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:15.297368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:15.305125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:15.379148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 852/1720] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:15 2022] POST /identity/v3/projects => generated 401 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:15.380155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:15.420603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:15.429250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:15.458501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 869/1721] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:23:15.535243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120fe4-7f60-4044-b242-b768cc0ffe8a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:15.552372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:15.553100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:15.553377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:15.553645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:15.554335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:15.556889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:15.562342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:15.606511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 853/1722] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:15 2022] POST /identity/v3/users => generated 307 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:15.614679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:15.615494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:15.641336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cff4c-f896-42c3-95a4-0992f94fdd87 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:15.657615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:15.658244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:15.658535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:15.659481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:15.659610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:15.661197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:15.699473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 854/1723] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:15.702318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:15.718520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08228-2c87-4e2c-acc2-adf6dddc17c3 service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:15.755170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dbd44-03a6-47df-a1b9-d340b89f57a9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:15.800402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:15.801329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:15.802773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:15.803864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] PATH_INFO: `/v3/projects/3e9334f8c67b4713a0fc13204dd93d32/users/94beea0b01884411ac72b793df6b97d7/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:15.849644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9334f8c67b4713a0fc13204dd93d32, user_id=94beea0b01884411ac72b793df6b97d7, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:15.858385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:15.920325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 855/1724] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:15 2022] PUT /identity/v3/projects/3e9334f8c67b4713a0fc13204dd93d32/users/94beea0b01884411ac72b793df6b97d7/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:15.924399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:15.976424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f34bba2d1b4ad795d22164b3e4f27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77a82568edfc4913bf40b7c60d57922e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:15.977539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:15.977912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:15.978199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:15.979007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:15.979264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:15.980947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.002991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:16.029063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 870/1725] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:23:16.031927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:16.066556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea56c5-9272-4963-9854-8e5c0066edd2 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:16.162423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70c24d-a3f4-42ab-adfb-1863e0263c24 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:16.175210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:16.176435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.176728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.177026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.177689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:16.180056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.214302 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 856/1726] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:16.215270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:16.216206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f34bba2d1b4ad795d22164b3e4f27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77a82568edfc4913bf40b7c60d57922e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:16.216860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.217141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.217411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.219570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:16.220087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:16.223454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.248258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209399-95d2-434d-937a-7676165310b6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:16.260444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:16.261123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.261395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.261668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] PATH_INFO: `/v3/projects/cc65c2db73b440bbaedb2af51e6e2899` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.264644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc65c2db73b440bbaedb2af51e6e2899)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:16.267031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.282920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 871/1727] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:16 2022] POST /identity/v3/projects => generated 354 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:16.284362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:16.391583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc65c2db73b440bbaedb2af51e6e2899', 'request_id': 'req-671bbebe-feec-4f01-8887-19d658f3fbec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.405150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc65c2db73b440bbaedb2af51e6e2899', 'request_id': 'req-671bbebe-feec-4f01-8887-19d658f3fbec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.409604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:16.418491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc65c2db73b440bbaedb2af51e6e2899', 'request_id': 'req-671bbebe-feec-4f01-8887-19d658f3fbec'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.443348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] The token cache is being invalidate because project cc65c2db73b440bbaedb2af51e6e2899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:16.443681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.446756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.447750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2449e-5d2f-4a86-941f-e36f76333cdd tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:16.451073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 857/1728] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:16 2022] DELETE /identity/v3/projects/cc65c2db73b440bbaedb2af51e6e2899 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:16.452391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:16.454278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:16.591369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:16.591995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.592275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.595424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] PATH_INFO: `/v3/projects/3e9334f8c67b4713a0fc13204dd93d32/users/94beea0b01884411ac72b793df6b97d7/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.606377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9334f8c67b4713a0fc13204dd93d32, user_id=94beea0b01884411ac72b793df6b97d7, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:16.609789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.635978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 872/1729] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:16 2022] PUT /identity/v3/projects/3e9334f8c67b4713a0fc13204dd93d32/users/94beea0b01884411ac72b793df6b97d7/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:16.636937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:16.645925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:16.655834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbebe-feec-4f01-8887-19d658f3fbec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:16.768762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:16.802583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f34bba2d1b4ad795d22164b3e4f27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77a82568edfc4913bf40b7c60d57922e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:16.804120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.805912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.806487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.809087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:16.810887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:16.815262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1c18f-c020-4850-ab38-a50a1a6b55cc tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.844191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937f381-060d-49d4-a57f-55a895d32e02 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:16.848333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 858/1730] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:16.852431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980689b5-bf28-4179-949d-834260d3f05c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.852765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980689b5-bf28-4179-949d-834260d3f05c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.853079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980689b5-bf28-4179-949d-834260d3f05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.861270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:16.862006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:16.862548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:16.863056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] PATH_INFO: `/v3/users/46ad5661590f420da557ba4d03f0ab51` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:16.866445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ad5661590f420da557ba4d03f0ab51)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:16.874285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:16.947015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-980689b5-bf28-4179-949d-834260d3f05c None None] MFA Rules not processed for user `94beea0b01884411ac72b793df6b97d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:16.952816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-980689b5-bf28-4179-949d-834260d3f05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:16.986644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ad5661590f420da557ba4d03f0ab51'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.988105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ad5661590f420da557ba4d03f0ab51'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:16.989135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ad5661590f420da557ba4d03f0ab51'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.008453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ad5661590f420da557ba4d03f0ab51'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.033917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ad5661590f420da557ba4d03f0ab51'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.112922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 873/1731] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:16 2022] DELETE /identity/v3/users/46ad5661590f420da557ba4d03f0ab51 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:17.114374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:17.125527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:17.145492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:17.254312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 859/1732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:17.267288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980689b5-bf28-4179-949d-834260d3f05c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:17.274434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-980689b5-bf28-4179-949d-834260d3f05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:17.339790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e0fb4-4b81-421c-983b-d659b47b0b4d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:17.352407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9f34bba2d1b4ad795d22164b3e4f27e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77a82568edfc4913bf40b7c60d57922e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:17.354418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:17.354928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:17.356217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] PATH_INFO: `/v3/projects/5ceab980f4e24e7cbea76fb4c5d9f887` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:17.359022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ceab980f4e24e7cbea76fb4c5d9f887)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:17.363795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:17.480614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980689b5-bf28-4179-949d-834260d3f05c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:17.485305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ceab980f4e24e7cbea76fb4c5d9f887', 'request_id': 'req-009732be-73ec-40df-bca9-02be85e5be12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.501758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ceab980f4e24e7cbea76fb4c5d9f887', 'request_id': 'req-009732be-73ec-40df-bca9-02be85e5be12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.518417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ceab980f4e24e7cbea76fb4c5d9f887', 'request_id': 'req-009732be-73ec-40df-bca9-02be85e5be12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.546445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] The token cache is being invalidate because project 5ceab980f4e24e7cbea76fb4c5d9f887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:17.547684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.550771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-009732be-73ec-40df-bca9-02be85e5be12 tempest-VolumeQuotaClassesTest-1216585025 tempest-VolumeQuotaClassesTest-1216585025-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:17.555709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 874/1733] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:17 2022] DELETE /identity/v3/projects/5ceab980f4e24e7cbea76fb4c5d9f887 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:17.557186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:17.572713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:17.574684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:17.657125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:17.661235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:17.691055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:17.691690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:17.692194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:17.692291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:17.734680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:17.904808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 875/1734] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Sep 28 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:17.968702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:18.065641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:18.067072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:18.081086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:18.082652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:18.101714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 860/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:18.107475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607db0d-95ea-4415-9cc5-49213862c7a3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:18.119091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:18.120600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:18.130982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:18.134912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:18.135813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:18.138286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:18.180360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:18.182137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:18.218056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 876/1736] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:18.230397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:18.233043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:18.271020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f0256-8a0c-486d-a2e8-98842560b6b5 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:18.298141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:18.299006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:18.299474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:18.299846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:18.306096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:18.310106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76801552-4df1-480d-8d25-3ac76d84c66d service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:18.327291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:18.327961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:18.328243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:18.328835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] PATH_INFO: `/v3/users/fe14648bce904f4e81cb88deb1cd690f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:18.351667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe14648bce904f4e81cb88deb1cd690f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:18.362309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:18.388628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:18.473999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:18.475923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca770c-bd74-4670-b02b-90b0617143d0 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:18.519458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 877/1737] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:18.541420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe14648bce904f4e81cb88deb1cd690f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:18.583674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe14648bce904f4e81cb88deb1cd690f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:18.584738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe14648bce904f4e81cb88deb1cd690f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:18.585479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe14648bce904f4e81cb88deb1cd690f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:18.610502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe14648bce904f4e81cb88deb1cd690f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:18.671022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 861/1738] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:18 2022] DELETE /identity/v3/users/fe14648bce904f4e81cb88deb1cd690f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:18.675721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:18.676258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:18.676899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:18.718496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:18.721477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:18.919284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 878/1739] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:19.010908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:19.012267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:19.280068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:19.293252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e11ee-24f9-4182-a4a3-9e5ec378cd32 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:19.301944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c553b9-8fbe-4360-b352-5b0b71d9ab69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:19.302976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c553b9-8fbe-4360-b352-5b0b71d9ab69 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:19.303348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c553b9-8fbe-4360-b352-5b0b71d9ab69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:19.303763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c553b9-8fbe-4360-b352-5b0b71d9ab69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:19.340985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c553b9-8fbe-4360-b352-5b0b71d9ab69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:19.342686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c553b9-8fbe-4360-b352-5b0b71d9ab69 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:19.365111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 862/1740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:20.562176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:20.564345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:20.588889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c1aa-a2b3-4bc8-9e64-e1bafacba222 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:20.603762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:20.604723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:20.605210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:20.605650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] PATH_INFO: `/v3/projects/0eee377a77ed47a29414aacfef3be2d5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:20.607621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eee377a77ed47a29414aacfef3be2d5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:20.609802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:20.750781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eee377a77ed47a29414aacfef3be2d5', 'request_id': 'req-4757418b-a22b-46ec-868e-c72b90c2d45e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:20.780813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eee377a77ed47a29414aacfef3be2d5', 'request_id': 'req-4757418b-a22b-46ec-868e-c72b90c2d45e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:20.819106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eee377a77ed47a29414aacfef3be2d5', 'request_id': 'req-4757418b-a22b-46ec-868e-c72b90c2d45e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:20.840818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] The token cache is being invalidate because project 0eee377a77ed47a29414aacfef3be2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:20.841123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:20.843502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4757418b-a22b-46ec-868e-c72b90c2d45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:20.846467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 879/1741] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:20 2022] DELETE /identity/v3/projects/0eee377a77ed47a29414aacfef3be2d5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:20.852567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:20.853116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:20.853212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:20.910785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:20.913817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:21.193260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 863/1742] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:21.197065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.197354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.198061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.272101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:21.280147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:21.311550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 880/1743] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:21.315649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:21.339453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aa69-c81a-4484-a276-5e01806285c5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:21.347690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:21.348480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.348921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.349285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.350056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:21.350463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:21.352630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:21.396485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:21.404982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 864/1744] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:21.422957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832151ca-6b17-4289-9354-dbf172ae8f51 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:21.430081 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:21.431022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.431401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.431766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.432528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:21.434745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:21.501764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 881/1745] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:21 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:21.506038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:21.526695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b790c4-8307-41b9-8048-21117caf21a9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:21.683335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:21.684307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.684688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.685313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.686320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:21.689231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:21.755162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 865/1746] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:21 2022] POST /identity/v3/users => generated 305 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:21.760514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:21.777029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa64472-21f4-4b35-98ff-17255e8978b4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:21.787886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:21.789553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.789944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.790306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.791190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:21.799117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:21.832368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 882/1747] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:21.836338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:21.856045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a69db-ca5a-43a1-8ff1-d1a49e048721 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:21.862562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d504-f872-498a-9033-3f69ff78a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:21.863317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d504-f872-498a-9033-3f69ff78a371 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.863737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d504-f872-498a-9033-3f69ff78a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.864064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d504-f872-498a-9033-3f69ff78a371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.864846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68d504-f872-498a-9033-3f69ff78a371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:21.867333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68d504-f872-498a-9033-3f69ff78a371 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:21.899082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 866/1748] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:21.903239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:21.917574 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c3e6-8997-431f-b363-a4cb087be7bf admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:21.928691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:21.930275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:21.931007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:21.931507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] PATH_INFO: `/v3/projects/d891e11ec39549e7942bc71f6137f6fe/users/da9878e491b44578a8c83db17ef61937/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:21.964576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:21.968212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d891e11ec39549e7942bc71f6137f6fe, user_id=da9878e491b44578a8c83db17ef61937, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:21.971585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:22.000260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 883/1749] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:21 2022] PUT /identity/v3/projects/d891e11ec39549e7942bc71f6137f6fe/users/da9878e491b44578a8c83db17ef61937/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:22.011637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.012086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.012535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.074093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] MFA Rules not processed for user `da9878e491b44578a8c83db17ef61937`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:22.075690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:22.179703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:22.214652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 867/1750] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:22.219069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:22.364974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635c93d-c7d4-4d1f-b6e3-df1c0da21fe0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:22.385952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1ac45-fe70-4b5b-b51e-be60d76bad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:22.386610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1ac45-fe70-4b5b-b51e-be60d76bad17 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.386940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1ac45-fe70-4b5b-b51e-be60d76bad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.387152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1ac45-fe70-4b5b-b51e-be60d76bad17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.387846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1ac45-fe70-4b5b-b51e-be60d76bad17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:22.389942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1ac45-fe70-4b5b-b51e-be60d76bad17 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:22.457001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 884/1751] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:22 2022] POST /identity/v3/projects => generated 407 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:22.461543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:22.476692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865bbef-ded0-4d25-a738-e7f85d0fe8ef None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:22.570729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208935-16b8-4619-b5ea-e2fa4688d426 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.570961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208935-16b8-4619-b5ea-e2fa4688d426 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.571481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208935-16b8-4619-b5ea-e2fa4688d426 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.573445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 885/1752] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:22.591971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.592260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.592698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.635394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:22.637976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:22.646042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:22.646641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.646948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.647219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.648507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:22.651253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:22.717565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 868/1753] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:22 2022] POST /identity/v3/users => generated 310 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:22.721012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:22.737868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b3ed-1d32-4e8e-a44e-969b592cf21b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:22.750761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:22.751786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.753055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.753761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.755080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:22.758416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:22.809031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 869/1754] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:22.812094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:22.823068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:22.850193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 886/1755] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:22.851620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:22.879099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490353a5-4899-4a12-8ac2-4aae1c024ad1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:22.886144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a19ec0-5351-484e-9a07-b02bc55c6462 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:22.895115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:22.896330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.896619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.896974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] PATH_INFO: `/v3/projects/85f813122af147b6a3fba00b85eb988a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.899536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f813122af147b6a3fba00b85eb988a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:22.904796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:22.914684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:22.915566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:22.915846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:22.916116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] PATH_INFO: `/v3/projects/14aaec724fb64a3d90088ec00b03ebd5/users/5b4676fe622047c4a02aab37960a6999/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:22.960945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14aaec724fb64a3d90088ec00b03ebd5, user_id=5b4676fe622047c4a02aab37960a6999, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:22.963890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:22.990201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 887/1756] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:22 2022] PUT /identity/v3/projects/14aaec724fb64a3d90088ec00b03ebd5/users/5b4676fe622047c4a02aab37960a6999/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:22.991078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:22.995818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:23.044762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f813122af147b6a3fba00b85eb988a', 'request_id': 'req-b9ac4131-37ac-4c79-ad57-97c008558b2d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.061169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f813122af147b6a3fba00b85eb988a', 'request_id': 'req-b9ac4131-37ac-4c79-ad57-97c008558b2d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.076989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f813122af147b6a3fba00b85eb988a', 'request_id': 'req-b9ac4131-37ac-4c79-ad57-97c008558b2d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.106295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] The token cache is being invalidate because project 85f813122af147b6a3fba00b85eb988a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:23.106641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.110309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.110929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 870/1757] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:22 2022] DELETE /identity/v3/projects/85f813122af147b6a3fba00b85eb988a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:23.111377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:23.117251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:23.119211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:23.182666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a834e24-f27c-4ea5-9f48-ca56255f00d3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:23.242999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:23.284891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac4131-37ac-4c79-ad57-97c008558b2d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:23.299410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:23.300406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:23.300921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:23.301416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:23.302441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:23.305678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:23.337392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 871/1758] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:23.338597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:23.344930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:23.354432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:23.357595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:23.358111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:23.360582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:23.363704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:23.385169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73110c5-690d-40d7-a419-a53ddf898e44 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:23.398849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:23.400038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:23.401287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:23.401826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] PATH_INFO: `/v3/users/a9f34bba2d1b4ad795d22164b3e4f27e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:23.402211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:23.405966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:23.407135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f34bba2d1b4ad795d22164b3e4f27e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:23.412613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:23.438835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 888/1759] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:23.440145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:23.463499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96be3c9-3f2b-4d3b-b72d-d6c845cc469e service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:23.472287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d26d7e-3585-4cc3-945a-f8cbe778fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:23.478631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26d7e-3585-4cc3-945a-f8cbe778fb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:23.479059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26d7e-3585-4cc3-945a-f8cbe778fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:23.479344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26d7e-3585-4cc3-945a-f8cbe778fb20 admin admin] PATH_INFO: `/v3/projects/14aaec724fb64a3d90088ec00b03ebd5/users/5b4676fe622047c4a02aab37960a6999/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:23.482131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d26d7e-3585-4cc3-945a-f8cbe778fb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14aaec724fb64a3d90088ec00b03ebd5, user_id=5b4676fe622047c4a02aab37960a6999, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:23.489616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d26d7e-3585-4cc3-945a-f8cbe778fb20 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:23.521486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f34bba2d1b4ad795d22164b3e4f27e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.529966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 889/1760] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:23 2022] PUT /identity/v3/projects/14aaec724fb64a3d90088ec00b03ebd5/users/5b4676fe622047c4a02aab37960a6999/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:23.541991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:23.542275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:23.542565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:23.552310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f34bba2d1b4ad795d22164b3e4f27e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.553555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f34bba2d1b4ad795d22164b3e4f27e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.555476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f34bba2d1b4ad795d22164b3e4f27e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.576813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f34bba2d1b4ad795d22164b3e4f27e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:23.617169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 872/1761] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:23 2022] DELETE /identity/v3/users/a9f34bba2d1b4ad795d22164b3e4f27e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:23.624867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] MFA Rules not processed for user `5b4676fe622047c4a02aab37960a6999`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:23.626144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:23.753352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 890/1762] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:23.761494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:23.763265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:23.991302 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772290a2-a235-4cd8-8cc4-50006edab183 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:24.006782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:24.011163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:24.011466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:24.016163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:24.050003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:24.053221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:24.114902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 873/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:24.395215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:24.397725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:24.498687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:24.544433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cee25-0305-41be-8bb9-33612ddb6bdd None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:24.561540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:24.562222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:24.562507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:24.562778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] PATH_INFO: `/v3/users/5ed4923aa3be4b66921b74c833677e81` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:24.563957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed4923aa3be4b66921b74c833677e81)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:24.566081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:24.567712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:24.575945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:24.589335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2019d-0612-4bd9-a019-772a040efd10 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:24.610613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:24.611440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:24.611663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:24.611944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:24.617599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:24.673941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed4923aa3be4b66921b74c833677e81'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:24.675037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed4923aa3be4b66921b74c833677e81'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:24.675749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed4923aa3be4b66921b74c833677e81'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:24.689326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed4923aa3be4b66921b74c833677e81'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:24.700058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a47d8270-e5a3-41d9-9b40-166e916face9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed4923aa3be4b66921b74c833677e81'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:24.726133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 891/1764] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:24 2022] DELETE /identity/v3/users/5ed4923aa3be4b66921b74c833677e81 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:24.728668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca4e-4a18-4b39-b33a-8accae1058b1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:24.730217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca4e-4a18-4b39-b33a-8accae1058b1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:24.730615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fca4e-4a18-4b39-b33a-8accae1058b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:24.781999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-691fca4e-4a18-4b39-b33a-8accae1058b1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:24.783278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-691fca4e-4a18-4b39-b33a-8accae1058b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:24.846944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:24.848441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:24.862472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:24.920486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 874/1765] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:24.928292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 892/1766] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:25.058571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:25.061960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:25.228294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf58f1-8ee1-4df6-a534-95b241971928 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:25.334514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:25.336045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:25.336045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:25.336368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:25.360934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:25.362724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:25.390159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 875/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:25.438855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7100-0a38-4159-9df4-4e245d07038b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:25.439864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7100-0a38-4159-9df4-4e245d07038b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:25.440612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7100-0a38-4159-9df4-4e245d07038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:25.470565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c63e7100-0a38-4159-9df4-4e245d07038b None None] MFA Rules not processed for user `0c34731e291046cbb634305a95ead7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:25.472170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c63e7100-0a38-4159-9df4-4e245d07038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:25.560012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 893/1768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:25.834475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:25.837191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:25.857777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19d4f-39be-4168-9973-588cc9829dd0 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:25.863597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:25.864715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:25.865312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:25.866381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] PATH_INFO: `/v3/projects/77a82568edfc4913bf40b7c60d57922e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:25.868249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a82568edfc4913bf40b7c60d57922e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:25.871918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:25.954255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a82568edfc4913bf40b7c60d57922e', 'request_id': 'req-2ae4c702-3a9c-423f-8afe-baaead5688ea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:25.971053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a82568edfc4913bf40b7c60d57922e', 'request_id': 'req-2ae4c702-3a9c-423f-8afe-baaead5688ea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:25.985271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a82568edfc4913bf40b7c60d57922e', 'request_id': 'req-2ae4c702-3a9c-423f-8afe-baaead5688ea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:26.033076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] The token cache is being invalidate because project 77a82568edfc4913bf40b7c60d57922e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:26.034360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:26.036209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ae4c702-3a9c-423f-8afe-baaead5688ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:26.049181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.049443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.049608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.062114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:26.066554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 876/1769] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:25 2022] DELETE /identity/v3/projects/77a82568edfc4913bf40b7c60d57922e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:26.086881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:26.088840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:26.263001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 894/1770] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:26.266035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.266612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.267082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.291521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:26.293283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:26.306933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 877/1771] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:26.309072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:26.326761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc67108-062f-43c2-bef7-3ed6996d91d0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:26.342596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:26.343257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.343539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.343811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.344484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:26.348979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:26.351471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:26.402609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 895/1772] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:26.402799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:26.430477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd0454-4b50-4f54-b580-dad97c4b7cc4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:26.448999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6021c-5b0d-42c2-9616-8f29599281c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:26.449646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6021c-5b0d-42c2-9616-8f29599281c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.449928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6021c-5b0d-42c2-9616-8f29599281c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.450198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6021c-5b0d-42c2-9616-8f29599281c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.450846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6021c-5b0d-42c2-9616-8f29599281c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:26.453123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6021c-5b0d-42c2-9616-8f29599281c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:26.526561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:26.532952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 878/1773] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:26 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:26.543842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02d4c-73d3-45e5-b8ab-e4924aac4f5f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:26.700061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679213d2-c0ac-443c-94f0-4e76623789b5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.700366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679213d2-c0ac-443c-94f0-4e76623789b5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.700933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679213d2-c0ac-443c-94f0-4e76623789b5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.703014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 879/1774] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:23:26.724606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:26.727695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.727972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.728244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.730441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:26.736622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:26.776835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 896/1775] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:26 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:26.780498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679213d2-c0ac-443c-94f0-4e76623789b5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:26.803413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679213d2-c0ac-443c-94f0-4e76623789b5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:26.815766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7b52e-994d-4ed4-a1cb-eb137c03c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:26.816625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7b52e-994d-4ed4-a1cb-eb137c03c180 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.816964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7b52e-994d-4ed4-a1cb-eb137c03c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.817288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7b52e-994d-4ed4-a1cb-eb137c03c180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.818005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7b52e-994d-4ed4-a1cb-eb137c03c180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:26.820647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7b52e-994d-4ed4-a1cb-eb137c03c180 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:26.833893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:26.847933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 880/1776] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:26.851379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:26.868608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d853f-ab86-4eca-8903-fb8b497b74f4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:26.904881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:26.905508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.905863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.906199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.906933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:26.908630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:26.930973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:26.931330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:26.931694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:26.978380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:26.978805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 897/1777] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:26.980296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:26.982122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:27.025475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213695-ba0a-4008-b378-72e51b282a66 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:27.043557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de936254-5760-4751-9b51-e53cd4c725ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:27.045558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de936254-5760-4751-9b51-e53cd4c725ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:27.046509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de936254-5760-4751-9b51-e53cd4c725ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:27.047806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de936254-5760-4751-9b51-e53cd4c725ea admin admin] PATH_INFO: `/v3/projects/2b0c243e9cd74682ba86b4a6c30c9772/users/6daf85bbfb6f419bbb2114b7f5eca697/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:27.105169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de936254-5760-4751-9b51-e53cd4c725ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c243e9cd74682ba86b4a6c30c9772, user_id=6daf85bbfb6f419bbb2114b7f5eca697, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:27.114271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de936254-5760-4751-9b51-e53cd4c725ea admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:27.171208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 898/1778] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:26 2022] PUT /identity/v3/projects/2b0c243e9cd74682ba86b4a6c30c9772/users/6daf85bbfb6f419bbb2114b7f5eca697/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:27.184585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:27.185276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:27.186041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:27.205010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 881/1779] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:27.261753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] MFA Rules not processed for user `6daf85bbfb6f419bbb2114b7f5eca697`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:27.270039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.340635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:27.342364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.361934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acd131-da2f-4483-8342-1f70d6b10588 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:27.393004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:27.478813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:27.479562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:27.480122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:27.480122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] PATH_INFO: `/v3/projects/e5ccb7374ba143bda886e61d6f684289` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:27.482155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ccb7374ba143bda886e61d6f684289)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:27.484548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:27.514838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 899/1780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:27.521932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:27.527962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.581698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ccb7374ba143bda886e61d6f684289', 'request_id': 'req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:27.593004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ccb7374ba143bda886e61d6f684289', 'request_id': 'req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:27.604468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ccb7374ba143bda886e61d6f684289', 'request_id': 'req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:27.654046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] The token cache is being invalidate because project e5ccb7374ba143bda886e61d6f684289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:27.654984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:27.656915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e80c7a-21cd-4849-9d0a-3ca1165d02c2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:27.668941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:27.673678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 882/1781] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:27 2022] DELETE /identity/v3/projects/e5ccb7374ba143bda886e61d6f684289 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:27.676398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:27.679635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.735462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:27.781102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:27.781796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:27.782091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:27.782994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:27.785167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.802208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:27.805352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca70eac-9288-402e-8c42-0c652159639d service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:27.807114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7b51-2a0f-4c1f-81ff-26609ed5574a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:27.824503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:27.825561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:27.826071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:27.827155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 900/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:27.829095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:27.829333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:27.829603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:27.840322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:27.846219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:27.848622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:27.868466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] MFA Rules not processed for user `8efaf0eb944e4f0bac9a77bca9b68e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:27.869881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.921431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 883/1783] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:27 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:27.921431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:27.922644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:27.987206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 901/1784] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:27.988426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:28.000560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:28.008983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c790-71d6-4665-b4ce-275eaddbf65f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:28.102770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:28.104467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.105359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.106760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.110222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:28.115501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:28.133614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4dc55-1bc2-46f6-8447-523d500da1ca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:28.145525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:28.146513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.146513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.146853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] PATH_INFO: `/v3/users/94beea0b01884411ac72b793df6b97d7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.149429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94beea0b01884411ac72b793df6b97d7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:28.154382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:28.170577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 902/1785] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:27 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:28.171589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:28.184461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa7f85-f269-465d-a5d4-960b895b5bc7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:28.199712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:28.200043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.200457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.200878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.201775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:28.203751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:28.230865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 903/1786] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:28.235229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:28.249183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa591-107b-4e6c-ac4d-7b062c9de7f4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:28.255007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:28.280503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.280503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.280503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] PATH_INFO: `/v3/projects/e70625dfef974c53885cf6e7b6916a90/users/79c058141f4e41229c24d5f58bb25740/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.290782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70625dfef974c53885cf6e7b6916a90, user_id=79c058141f4e41229c24d5f58bb25740, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:28.295989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:28.300487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94beea0b01884411ac72b793df6b97d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:28.326417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 904/1787] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:28 2022] PUT /identity/v3/projects/e70625dfef974c53885cf6e7b6916a90/users/79c058141f4e41229c24d5f58bb25740/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:28.331214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94beea0b01884411ac72b793df6b97d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:28.332665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94beea0b01884411ac72b793df6b97d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:28.333786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94beea0b01884411ac72b793df6b97d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:28.335496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:28.340867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:28.352310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94beea0b01884411ac72b793df6b97d7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:28.400365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 884/1788] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:27 2022] DELETE /identity/v3/users/94beea0b01884411ac72b793df6b97d7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:28.510145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18e17-0f20-4859-90cb-0d9b948a0fdc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:28.673743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2a1d-4b88-475d-8047-4bef1d60fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:28.676689 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2a1d-4b88-475d-8047-4bef1d60fd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.677166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2a1d-4b88-475d-8047-4bef1d60fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.678667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2a1d-4b88-475d-8047-4bef1d60fd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.681357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2a1d-4b88-475d-8047-4bef1d60fd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:28.686398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2a1d-4b88-475d-8047-4bef1d60fd11 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:28.732760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 905/1789] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:28.735654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:28.779241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda97a4c-742c-4bce-a2c4-e2096cd7614e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:28.795852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:28.799805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.800426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.801998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] PATH_INFO: `/v3/projects/e70625dfef974c53885cf6e7b6916a90/users/79c058141f4e41229c24d5f58bb25740/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.822354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70625dfef974c53885cf6e7b6916a90, user_id=79c058141f4e41229c24d5f58bb25740, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:28.839943 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:28.878717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 885/1790] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:28 2022] PUT /identity/v3/projects/e70625dfef974c53885cf6e7b6916a90/users/79c058141f4e41229c24d5f58bb25740/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:28.891037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:28.892016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:28.892145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:28.906480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:28.946722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] MFA Rules not processed for user `79c058141f4e41229c24d5f58bb25740`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:28.948936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.069433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 906/1791] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:29.088600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:29.090446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.112816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:29.187209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73322893-c64b-4e17-9564-c5a42a97b583 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:29.193109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:29.193839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.194191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.194566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.208099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:29.210516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:29.224313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 886/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:29.269152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:29.270671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.452709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529a70-92c6-4b44-8e59-34e338af6d8d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:29.464522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:29.465196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.465470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.465789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] PATH_INFO: `/v3/projects/3e9334f8c67b4713a0fc13204dd93d32` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.468448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9334f8c67b4713a0fc13204dd93d32)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:29.470366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:29.499979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:29.513986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272803d-e390-4562-b806-52012cfe344d service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:29.520715 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:29.521953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.523230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.524253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] PATH_INFO: `/v3/users/6daf85bbfb6f419bbb2114b7f5eca697` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.525760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6daf85bbfb6f419bbb2114b7f5eca697)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:29.528472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:29.582440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9334f8c67b4713a0fc13204dd93d32', 'request_id': 'req-b89e5183-ebef-49db-bf7a-83b1f8507ceb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.595086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9334f8c67b4713a0fc13204dd93d32', 'request_id': 'req-b89e5183-ebef-49db-bf7a-83b1f8507ceb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.602474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9334f8c67b4713a0fc13204dd93d32', 'request_id': 'req-b89e5183-ebef-49db-bf7a-83b1f8507ceb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.624510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6daf85bbfb6f419bbb2114b7f5eca697'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.640111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6daf85bbfb6f419bbb2114b7f5eca697'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.641665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6daf85bbfb6f419bbb2114b7f5eca697'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.642485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6daf85bbfb6f419bbb2114b7f5eca697'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.649253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] The token cache is being invalidate because project 3e9334f8c67b4713a0fc13204dd93d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:29.649548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.650201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b89e5183-ebef-49db-bf7a-83b1f8507ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.656996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 907/1793] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:29 2022] DELETE /identity/v3/projects/3e9334f8c67b4713a0fc13204dd93d32 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:29.657345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f605aad2-a3d0-419c-aec6-acaaf1a383d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6daf85bbfb6f419bbb2114b7f5eca697'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:29.661139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498adc0-f04b-40c6-9687-df0db8013bf3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.661435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498adc0-f04b-40c6-9687-df0db8013bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.661713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498adc0-f04b-40c6-9687-df0db8013bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.688635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2498adc0-f04b-40c6-9687-df0db8013bf3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:29.689990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2498adc0-f04b-40c6-9687-df0db8013bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.699414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 887/1794] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:29 2022] DELETE /identity/v3/users/6daf85bbfb6f419bbb2114b7f5eca697 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:29.705297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8fff1-5386-4e05-adc8-53ce3479ac38 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.705827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8fff1-5386-4e05-adc8-53ce3479ac38 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.706348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8fff1-5386-4e05-adc8-53ce3479ac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.719502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:29.737478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5fb8fff1-5386-4e05-adc8-53ce3479ac38 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:29.739157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5fb8fff1-5386-4e05-adc8-53ce3479ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.832132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 888/1795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:29.836687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.836956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.837231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.839805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 908/1796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:29.847625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:29.847945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:29.848220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:29.904345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] MFA Rules not processed for user `6ebfeba30aa342a99e0d5855f9ac8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:29.909220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.911229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:29.912756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.935989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 909/1797] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:29.936354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:29.939080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:29.959512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:30.036946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 889/1798] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:30.039268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.054045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68156b98-245e-4df2-bd92-2f1838c7c698 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.059638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.060800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.060989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.061408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.062162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:30.062466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.064655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.081175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 890/1799] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:30.086841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.097844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3399159-fc8d-4337-99fc-426740ac3dbe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.102156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d9b5e-a4f6-4d8c-ab79-ad7459b7968c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.102978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.103578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.103852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.104121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.104977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.107120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.117536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.120933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.121583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.121583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.134272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.138143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.145308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 891/1800] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:30 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:30.150375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.157399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 910/1801] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:30.247057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48176ae-69c9-437f-a582-2709f11e94bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.253011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.253803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.254082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.254352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.255601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.258537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.286249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 892/1802] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:30 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:30.290909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.310211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ecf9-57a3-4e34-aa7b-5523c0bedf8e service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.330624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.331308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.331816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.332249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.332979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.335483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.370007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 911/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:30.374151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.388737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06829a-f579-4680-9a26-9ba2ba25af9c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.402914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631b8c-c487-4e60-9f92-8a5df44391f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.403623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631b8c-c487-4e60-9f92-8a5df44391f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.403816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631b8c-c487-4e60-9f92-8a5df44391f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.404141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631b8c-c487-4e60-9f92-8a5df44391f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.405485 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2631b8c-c487-4e60-9f92-8a5df44391f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.407099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2631b8c-c487-4e60-9f92-8a5df44391f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.439166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 893/1804] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:30.441636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.466593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65731179-947b-4f0f-8c9b-45213be6caf3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.486046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.488613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.489141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.490492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] PATH_INFO: `/v3/projects/1c46822c24bc4e5182f55aff8aff6858/users/67d4044221d7468cb0efc4cf4cff4a18/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.521665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c46822c24bc4e5182f55aff8aff6858, user_id=67d4044221d7468cb0efc4cf4cff4a18, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.528280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.559497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 912/1805] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:30 2022] PUT /identity/v3/projects/1c46822c24bc4e5182f55aff8aff6858/users/67d4044221d7468cb0efc4cf4cff4a18/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:30.569814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.570415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.570604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.614519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] MFA Rules not processed for user `67d4044221d7468cb0efc4cf4cff4a18`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:30.615275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:30.718143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 894/1806] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:30.722406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.831036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d5ebd-e00d-4271-9516-f4a03079295b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.836392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.837101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.837443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.837775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.838468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.840844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.873633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 913/1807] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:30 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:30.873879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.875074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:30.875317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:30.880926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:30.897480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557727bb-8029-49d2-b4f8-affb7a0e1deb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.903837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:30.977817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.978663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.979165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.979497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] PATH_INFO: `/v3/projects/2b0c243e9cd74682ba86b4a6c30c9772` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.980929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0c243e9cd74682ba86b4a6c30c9772)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.982905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:30.985958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec25d-f717-40e7-950e-cc31a66eb623 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:30.995014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:30.995880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:30.996404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:30.996682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:30.997520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:30.999865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:31.042510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 914/1808] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:30 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:31.045598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0c243e9cd74682ba86b4a6c30c9772', 'request_id': 'req-1300ba1b-7685-40ee-9a4b-f05933a331f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.046660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:31.055275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0c243e9cd74682ba86b4a6c30c9772', 'request_id': 'req-1300ba1b-7685-40ee-9a4b-f05933a331f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.063642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ddfc8-3364-4cde-a0d5-32787b5c14da admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:31.070242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0c243e9cd74682ba86b4a6c30c9772', 'request_id': 'req-1300ba1b-7685-40ee-9a4b-f05933a331f4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.083169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] The token cache is being invalidate because project 2b0c243e9cd74682ba86b4a6c30c9772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:31.083457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.084121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.088852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 895/1809] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:30 2022] DELETE /identity/v3/projects/2b0c243e9cd74682ba86b4a6c30c9772 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:31.090536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:31.092380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:31.159843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:31.160646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:31.161053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:31.161532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:31.162282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:31.165173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:31.174323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300ba1b-7685-40ee-9a4b-f05933a331f4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:31.179986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:31.180380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 915/1810] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:31.180865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:31.181254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:31.181593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] PATH_INFO: `/v3/users/79c058141f4e41229c24d5f58bb25740` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:31.182867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c058141f4e41229c24d5f58bb25740)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:31.184435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:31.185839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:31.186716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:31.206592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48829-0f10-415a-839f-9c85db95b578 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:31.213794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:31.214593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:31.215150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:31.222557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] PATH_INFO: `/v3/projects/2a1598170a6e48d79ad2cb2a1bb57a24/users/751c1e1ac1504168b9571d64d6ef2279/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:31.246703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1598170a6e48d79ad2cb2a1bb57a24, user_id=751c1e1ac1504168b9571d64d6ef2279, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:31.250230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:31.270901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 916/1811] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:31 2022] PUT /identity/v3/projects/2a1598170a6e48d79ad2cb2a1bb57a24/users/751c1e1ac1504168b9571d64d6ef2279/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:31.275953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:31.295649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:31.315598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c058141f4e41229c24d5f58bb25740'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.339504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c058141f4e41229c24d5f58bb25740'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.340446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c058141f4e41229c24d5f58bb25740'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.341113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c058141f4e41229c24d5f58bb25740'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.357600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0663b7d-0b32-4539-a991-044de6dee262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c058141f4e41229c24d5f58bb25740'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:31.368079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a0f3-e25b-4ee2-83c8-4c1e0a15a92f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:31.373834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:31.374599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:31.374997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:31.375518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:31.376557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:31.378402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:31.400244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 917/1813] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:31.401341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:31.402129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 896/1813] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:31 2022] DELETE /identity/v3/users/79c058141f4e41229c24d5f58bb25740 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:31.406233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:31.436311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:31.448317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc3711-6caa-450e-9320-630c7307b0b8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:31.635843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:31.638433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:31.638716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:31.638988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] PATH_INFO: `/v3/projects/2a1598170a6e48d79ad2cb2a1bb57a24/users/751c1e1ac1504168b9571d64d6ef2279/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:31.645165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1598170a6e48d79ad2cb2a1bb57a24, user_id=751c1e1ac1504168b9571d64d6ef2279, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:31.649523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:31.698341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 918/1814] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:31 2022] PUT /identity/v3/projects/2a1598170a6e48d79ad2cb2a1bb57a24/users/751c1e1ac1504168b9571d64d6ef2279/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:31.711801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:31.712375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:31.713185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:31.771414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] MFA Rules not processed for user `751c1e1ac1504168b9571d64d6ef2279`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:31.773270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:31.984849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 897/1815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:32.001805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.005407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.026641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.029337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.109906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe3ce-9280-4506-825e-b860a09fd4f9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.114933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.116470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.117020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.117410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.137457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.139147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.162131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 919/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:32.163860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ea972-93ea-4288-8bb3-3ea2cdd5a2f2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.164217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.165737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.171640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.172369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.172735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.173371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] PATH_INFO: `/v3/projects/e70625dfef974c53885cf6e7b6916a90` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.174692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70625dfef974c53885cf6e7b6916a90)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.176669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.181385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c58a-498c-464e-b686-3e2fd47755a6 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.186458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.187172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.187543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.187871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] PATH_INFO: `/v3/users/da9878e491b44578a8c83db17ef61937` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.189116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9878e491b44578a8c83db17ef61937)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.191868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.276984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:32.290674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70625dfef974c53885cf6e7b6916a90', 'request_id': 'req-b06de5b9-06da-4d9d-a63f-a8b7e056f887'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.298994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9878e491b44578a8c83db17ef61937'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.300158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9878e491b44578a8c83db17ef61937'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.300817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9878e491b44578a8c83db17ef61937'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.311887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70625dfef974c53885cf6e7b6916a90', 'request_id': 'req-b06de5b9-06da-4d9d-a63f-a8b7e056f887'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.327551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9878e491b44578a8c83db17ef61937'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.330636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70625dfef974c53885cf6e7b6916a90', 'request_id': 'req-b06de5b9-06da-4d9d-a63f-a8b7e056f887'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.362601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] The token cache is being invalidate because project e70625dfef974c53885cf6e7b6916a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:32.362905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.367243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.371457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 898/1817] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:32 2022] DELETE /identity/v3/projects/e70625dfef974c53885cf6e7b6916a90 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:32.372181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c09a3c7-9f19-4254-94ed-25b9ad3a43f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9878e491b44578a8c83db17ef61937'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:32.372307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.374561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.427710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 920/1818] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:32 2022] DELETE /identity/v3/users/da9878e491b44578a8c83db17ef61937 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:32.433596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346a36e-7bac-4316-b658-eb0dae618db6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.434206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346a36e-7bac-4316-b658-eb0dae618db6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.434664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346a36e-7bac-4316-b658-eb0dae618db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.478266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8346a36e-7bac-4316-b658-eb0dae618db6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:32.479829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8346a36e-7bac-4316-b658-eb0dae618db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.483563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de5b9-06da-4d9d-a63f-a8b7e056f887 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.488764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:32.626540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.627172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.627451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.627714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.636926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 921/1819] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:32.636926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c53ef-30c0-4200-b1f2-a556c1899064 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.636926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c53ef-30c0-4200-b1f2-a556c1899064 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.636926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c53ef-30c0-4200-b1f2-a556c1899064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.638668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.672983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-964c53ef-30c0-4200-b1f2-a556c1899064 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:32.674284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-964c53ef-30c0-4200-b1f2-a556c1899064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.693246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 922/1820] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:32.697699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b04b6-f963-4695-b137-59335075751e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.698203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b04b6-f963-4695-b137-59335075751e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.698646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b04b6-f963-4695-b137-59335075751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.733694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ec9b04b6-f963-4695-b137-59335075751e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:32.735755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec9b04b6-f963-4695-b137-59335075751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.758108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 923/1821] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:32.758960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b04b6-f963-4695-b137-59335075751e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.761373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec9b04b6-f963-4695-b137-59335075751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:32.762452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.777532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.796476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 899/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:32.808538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.829653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7b05-09e8-4819-aa7b-1ed362719766 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.836488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.838123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.838505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.838963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.839762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:32.840171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.843040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.866937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 900/1823] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:32.875380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:32.889764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe6621-bf8d-4ccd-aec6-b9423bdcfb51 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.906372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.907483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.909734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.910458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.911433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.916503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.940507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b04b6-f963-4695-b137-59335075751e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:32.950132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:32.950988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:32.951844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:32.953778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:32.986414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:32.990068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:32.990478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 901/1824] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:32 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:32.995062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:33.026692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 924/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:33.033281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:33.149406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343277-512e-42a3-ab02-d68cee7da86b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:33.154991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:33.156594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:33.157141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:33.157950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:33.159148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:33.161858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:33.229523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 902/1826] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:32 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:33.232949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:33.248536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fd0ec-f2ae-4b65-ae6b-0cfb7cae940d service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:33.281869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:33.282608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:33.282880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:33.283240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:33.283951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:33.285670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:33.305003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 925/1827] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:33.307465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:33.322633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d36c0-e8e4-4988-ac89-3831749c06b8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:33.334181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0e8a-d87f-4456-b6b6-b02331bcf04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:33.335385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0e8a-d87f-4456-b6b6-b02331bcf04e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:33.335880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0e8a-d87f-4456-b6b6-b02331bcf04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:33.336293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0e8a-d87f-4456-b6b6-b02331bcf04e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:33.337031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc0e8a-d87f-4456-b6b6-b02331bcf04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:33.339150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc0e8a-d87f-4456-b6b6-b02331bcf04e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:33.371501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:33.377755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 903/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:33.384746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc1630-e238-4452-9ad5-c9cd13dd0e91 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:33.405036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:33.406099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:33.406230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:33.406438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] PATH_INFO: `/v3/projects/fe9cef7d08074623a0b79254476fc7b2/users/723f661c143e43c88d17bf51d4498c9e/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:33.424330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9cef7d08074623a0b79254476fc7b2, user_id=723f661c143e43c88d17bf51d4498c9e, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:33.428855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:33.452803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 926/1829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:33 2022] PUT /identity/v3/projects/fe9cef7d08074623a0b79254476fc7b2/users/723f661c143e43c88d17bf51d4498c9e/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:33.463702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:33.463985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:33.464247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:33.574756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] MFA Rules not processed for user `723f661c143e43c88d17bf51d4498c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:33.579087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:33.719799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 904/1830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:33.733888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:33.857588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ac71-5eaa-43e6-9fd1-f84b3d6e7789 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:33.866688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81de6d-280b-4275-8561-4ad858bd0f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:33.869414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81de6d-280b-4275-8561-4ad858bd0f76 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:33.869414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81de6d-280b-4275-8561-4ad858bd0f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:33.869414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81de6d-280b-4275-8561-4ad858bd0f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:33.887999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81de6d-280b-4275-8561-4ad858bd0f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:33.891303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81de6d-280b-4275-8561-4ad858bd0f76 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:33.910825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 927/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:33.964519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:34.060466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b75f-4c46-41ae-a65e-2111e5c380f8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:34.069916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:34.070588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.070870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.071141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] PATH_INFO: `/v3/users/723f661c143e43c88d17bf51d4498c9e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.073920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723f661c143e43c88d17bf51d4498c9e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:34.077686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:34.109381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:34.166320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723f661c143e43c88d17bf51d4498c9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:34.175313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723f661c143e43c88d17bf51d4498c9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:34.176347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723f661c143e43c88d17bf51d4498c9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:34.178164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723f661c143e43c88d17bf51d4498c9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:34.193115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f205a788-89fb-44c6-8868-593d240b9793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723f661c143e43c88d17bf51d4498c9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:34.254145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 905/1832] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:33 2022] DELETE /identity/v3/users/723f661c143e43c88d17bf51d4498c9e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:34.259694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.260151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.260335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.323608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52c6a1-4bfb-4c54-b3c6-769d695400f0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.324325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52c6a1-4bfb-4c54-b3c6-769d695400f0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.324815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52c6a1-4bfb-4c54-b3c6-769d695400f0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.326366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 906/1833] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 12:23:34.341790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:34.343007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:34.354695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.355104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.355477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.361037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:34.417217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:34.417217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:34.490399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 928/1834] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:34.572018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:34.573800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:34.635957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 907/1835] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:34.695027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7fbda-ccf8-40ce-9fd8-fc1d02a9499b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:34.701428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:34.701428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.701428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.701428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.713931 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:34.715420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:34.728676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 929/1836] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:34.827831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:34.829554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:34.855350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f184b0-0545-4c82-bae9-c034633b24ed None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:34.871635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:34.872631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.872631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.872850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.883705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:34.885206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:34.889518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:34.892014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:34.906262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 908/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:34.906654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03dd0-1be8-4894-b5b9-b36dd1c94bbc service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:34.915234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:34.916162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:34.916629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:34.917114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] PATH_INFO: `/v3/projects/d891e11ec39549e7942bc71f6137f6fe` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:34.918680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d891e11ec39549e7942bc71f6137f6fe)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:34.921097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:34.999162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd891e11ec39549e7942bc71f6137f6fe', 'request_id': 'req-1f7eea63-498e-43dd-9c24-32501bea6a52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.008926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd891e11ec39549e7942bc71f6137f6fe', 'request_id': 'req-1f7eea63-498e-43dd-9c24-32501bea6a52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.025398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd891e11ec39549e7942bc71f6137f6fe', 'request_id': 'req-1f7eea63-498e-43dd-9c24-32501bea6a52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.040160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] The token cache is being invalidate because project d891e11ec39549e7942bc71f6137f6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:35.040692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.041760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.043852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 930/1838] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:34 2022] DELETE /identity/v3/projects/d891e11ec39549e7942bc71f6137f6fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:35.049807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:35.070045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619134ef-74f3-4842-8689-22d33e542386 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:35.158503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:35.160321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:35.160633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:35.160986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] PATH_INFO: `/v3/users/5b4676fe622047c4a02aab37960a6999` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:35.162463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4676fe622047c4a02aab37960a6999)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:35.165139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:35.189684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:35.232844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4676fe622047c4a02aab37960a6999'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.239877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4676fe622047c4a02aab37960a6999'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.240587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4676fe622047c4a02aab37960a6999'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.242286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4676fe622047c4a02aab37960a6999'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.251564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a5c75c59-e346-4900-9b27-695aa66398ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4676fe622047c4a02aab37960a6999'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:35.279957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 909/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:35 2022] DELETE /identity/v3/users/5b4676fe622047c4a02aab37960a6999 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:35.643900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:35.648317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:35.676447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eea63-498e-43dd-9c24-32501bea6a52 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:35.780598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:35.852255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:35.853079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:35.853405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:35.857066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] PATH_INFO: `/v3/projects/fe9cef7d08074623a0b79254476fc7b2` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:35.861129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9cef7d08074623a0b79254476fc7b2)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:35.867587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.024174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9cef7d08074623a0b79254476fc7b2', 'request_id': 'req-2ea627a4-92a0-475f-8246-df4f6b269ddb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.033438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9cef7d08074623a0b79254476fc7b2', 'request_id': 'req-2ea627a4-92a0-475f-8246-df4f6b269ddb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.041436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9cef7d08074623a0b79254476fc7b2', 'request_id': 'req-2ea627a4-92a0-475f-8246-df4f6b269ddb'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.062165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] The token cache is being invalidate because project fe9cef7d08074623a0b79254476fc7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:36.062465 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.063208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ea627a4-92a0-475f-8246-df4f6b269ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.065889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 931/1840] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:35 2022] DELETE /identity/v3/projects/fe9cef7d08074623a0b79254476fc7b2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:36.070867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.071398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.071602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.115288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:36.121197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:36.224009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 910/1841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:36.233033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.233493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.234717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.285917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:36.287496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:36.315849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 932/1842] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:36.317048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.331832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecd8d2-b818-4e94-9297-bb3626471bda None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.343104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.344553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.345113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.345386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.346099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:36.346398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.348065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.371834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 911/1843] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:23:36.375993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.392745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73b472-8219-4be3-8419-456bb2024fd8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.402525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.403206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.403509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.403816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.404552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.407241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.461212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 933/1844] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:36.461768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.477451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697999a-9a63-470c-a89e-4ca045ad36d3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.574674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.578500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:36.585650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.586599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.586881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.587158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.588056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.591080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.594117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b24c2d-bfa7-4aa4-9f40-b8d922aade4b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.606439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.608216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.608454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.608727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] PATH_INFO: `/v3/projects/14aaec724fb64a3d90088ec00b03ebd5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.610237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14aaec724fb64a3d90088ec00b03ebd5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.613167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.628894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 912/1845] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:36.634296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.655511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3c52-44b0-4135-988d-eae4ba10bc7c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.673564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.674216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.674488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.674761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.676924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.679553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.682260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:36.698420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 913/1846] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:36.699757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.721124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386890-d7dd-4b31-9609-c2890cc6640b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.731300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.733565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.733930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.734304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.735044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.739113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.765202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14aaec724fb64a3d90088ec00b03ebd5', 'request_id': 'req-dc46140f-5e00-493c-a5f1-cb31121fe570'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.773049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 914/1847] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:36.777332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:36.778521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14aaec724fb64a3d90088ec00b03ebd5', 'request_id': 'req-dc46140f-5e00-493c-a5f1-cb31121fe570'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.787257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14aaec724fb64a3d90088ec00b03ebd5', 'request_id': 'req-dc46140f-5e00-493c-a5f1-cb31121fe570'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.796931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9c24-166a-4f94-9139-ab9f5629b8fe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:36.837267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] The token cache is being invalidate because project 14aaec724fb64a3d90088ec00b03ebd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:36.837573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.841055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dc46140f-5e00-493c-a5f1-cb31121fe570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:36.846320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 934/1848] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:36 2022] DELETE /identity/v3/projects/14aaec724fb64a3d90088ec00b03ebd5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:36.852074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe302-039c-46d9-832e-9aa24e23a0a5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.852391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe302-039c-46d9-832e-9aa24e23a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.852658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe302-039c-46d9-832e-9aa24e23a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.899266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fb2fe302-039c-46d9-832e-9aa24e23a0a5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:36.899988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4322df9-243e-4bd5-8245-da77bd54f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:36.900793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4322df9-243e-4bd5-8245-da77bd54f7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.901339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4322df9-243e-4bd5-8245-da77bd54f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.901713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4322df9-243e-4bd5-8245-da77bd54f7cb admin admin] PATH_INFO: `/v3/projects/803f0a46b7f24b2a8f869640668190ee/users/0671e7751dd940aea015acc93611d3e7/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.905119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fb2fe302-039c-46d9-832e-9aa24e23a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:36.946732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 935/1849] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:36.948430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.948718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.950319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4322df9-243e-4bd5-8245-da77bd54f7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=803f0a46b7f24b2a8f869640668190ee, user_id=0671e7751dd940aea015acc93611d3e7, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:36.952612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:36.954929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4322df9-243e-4bd5-8245-da77bd54f7cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:36.977700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 915/1850] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:36 2022] PUT /identity/v3/projects/803f0a46b7f24b2a8f869640668190ee/users/0671e7751dd940aea015acc93611d3e7/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:36.988200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:36.988994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:36.989526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.009868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:37.011883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:37.027459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:37.062593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] MFA Rules not processed for user `0671e7751dd940aea015acc93611d3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:37.063858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:37.199481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 936/1851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:37.205835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.222122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 916/1852] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:37.229072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0342f-dfe0-4112-930b-c346fb0ae5a4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:37.234728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.237644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:37.242510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:37.245498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:37.245789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:37.246063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.247759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:37.248362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:37.253186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:37.291775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 937/1853] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:37.297401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.321719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afa9fc-d2c0-4b9c-8da5-9c8583b6811e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:37.335600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:37.336227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:37.340156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:37.340440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.341140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:37.343066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:37.349438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950737b-b983-41d0-83c2-0f9dffa2cfbf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:37.356071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:37.356935 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:37.357517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:37.357934 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.395628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:37.402209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:37.414597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 938/1854] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:37 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:37.422413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.427995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 917/1855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:37.637731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1a3b-2ea3-4835-a120-24440bd74c25 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:37.651796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:37.654731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:37.656340 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:37.656715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.657574 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:37.660310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:37.705273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 939/1856] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:37 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:37.707050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.715559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:37.727079 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e7e57-199e-4d94-9d89-0b83541a5b15 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:37.752041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:37.760804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:37.761104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:37.761380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.762061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:37.776187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:37.867415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 918/1857] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:37.869826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.890991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448274d-e77b-456e-8d15-134106ad6702 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:37.899188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c8639-6bf4-479f-979a-b0b3f368c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:37.900945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c8639-6bf4-479f-979a-b0b3f368c005 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:37.901227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c8639-6bf4-479f-979a-b0b3f368c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:37.902942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c8639-6bf4-479f-979a-b0b3f368c005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:37.907204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c8639-6bf4-479f-979a-b0b3f368c005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:37.920288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c8639-6bf4-479f-979a-b0b3f368c005 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:37.950645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 940/1858] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:37.957859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:37.980280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde0fc1-18b2-491b-96a4-6ea8f1bf626c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:38.003595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:38.004451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.004898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.005309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] PATH_INFO: `/v3/projects/b36be5ec2e014f8eb19be57206d54e40/users/e36a12ba358d44118adf8dc3e4822a49/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.045049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36be5ec2e014f8eb19be57206d54e40, user_id=e36a12ba358d44118adf8dc3e4822a49, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:38.052642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:38.090488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 919/1859] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:37 2022] PUT /identity/v3/projects/b36be5ec2e014f8eb19be57206d54e40/users/e36a12ba358d44118adf8dc3e4822a49/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:38.102108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.103025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.103534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.200304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] MFA Rules not processed for user `e36a12ba358d44118adf8dc3e4822a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:38.201607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:38.328821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:38.363052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 941/1860] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:38.368649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:38.472495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fb75-57bc-4d77-820b-d601c8461747 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:38.482698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:38.483429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.483801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.484113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.484852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:38.487255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:38.560368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 920/1861] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:38 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:38.560648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:38.583101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d062e-d97b-4828-8e4a-2e86ef5ce9b3 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:38.679226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:38.679842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.680123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.680396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.681065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:38.683067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:38.732925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 942/1862] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:38 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:38.736525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:38.755022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636bb9e-94e0-40d6-83dd-35a396662b14 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:38.789130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:38.789770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.790053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.792844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.793586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:38.796071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:38.816541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 921/1863] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:38.820538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:38.838429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8bf5a-7c75-4aaa-bc08-6748eb644b08 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:38.847976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:38.848764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.849147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.849532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] PATH_INFO: `/v3/projects/ba565aaef0634eadbfc3cf5dc5cc977b/users/7b06350840814b2685ddba9ad98726b2/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.866764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba565aaef0634eadbfc3cf5dc5cc977b, user_id=7b06350840814b2685ddba9ad98726b2, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:38.869580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:38.884526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 943/1864] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:38 2022] PUT /identity/v3/projects/ba565aaef0634eadbfc3cf5dc5cc977b/users/7b06350840814b2685ddba9ad98726b2/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:38.888557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:38.899662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245c9b4-5d84-4517-9398-d208b6b27837 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:38.960136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29905d43-cdba-4831-a96e-e9d352a55a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:38.960752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29905d43-cdba-4831-a96e-e9d352a55a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:38.961056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29905d43-cdba-4831-a96e-e9d352a55a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:38.961730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29905d43-cdba-4831-a96e-e9d352a55a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:38.962113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29905d43-cdba-4831-a96e-e9d352a55a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:38.963695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29905d43-cdba-4831-a96e-e9d352a55a2c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:38.978437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 922/1865] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:38.979725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:38.996630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c411-a160-4d60-a8be-ac2fb25917fc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:39.001789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:39.002523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:39.002820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:39.003201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] PATH_INFO: `/v3/projects/ba565aaef0634eadbfc3cf5dc5cc977b/users/7b06350840814b2685ddba9ad98726b2/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:39.005147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba565aaef0634eadbfc3cf5dc5cc977b, user_id=7b06350840814b2685ddba9ad98726b2, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:39.008331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:39.019829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 944/1866] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:38 2022] PUT /identity/v3/projects/ba565aaef0634eadbfc3cf5dc5cc977b/users/7b06350840814b2685ddba9ad98726b2/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:39.031685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:39.031942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:39.032217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:39.080564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] MFA Rules not processed for user `7b06350840814b2685ddba9ad98726b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:39.081895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:39.120008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:39.143605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:39.145304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:39.188451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 923/1867] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:39.196625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:39.251034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c4e8-6a7d-451b-b54f-7488589138af admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:39.256039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:39.256843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:39.257262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:39.257635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] PATH_INFO: `/v3/users/67d4044221d7468cb0efc4cf4cff4a18` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:39.259016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d4044221d7468cb0efc4cf4cff4a18)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:39.261998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:39.280199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d556d-4b70-4d29-9491-c0d82613b1d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:39.284619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256977b0-2973-48d4-a3d2-ddab943b9b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:39.285452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256977b0-2973-48d4-a3d2-ddab943b9b01 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:39.286756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256977b0-2973-48d4-a3d2-ddab943b9b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:39.287166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256977b0-2973-48d4-a3d2-ddab943b9b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:39.305508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256977b0-2973-48d4-a3d2-ddab943b9b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:39.310937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256977b0-2973-48d4-a3d2-ddab943b9b01 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:39.323667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:39.336554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d4044221d7468cb0efc4cf4cff4a18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:39.337820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 924/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:39.351675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d4044221d7468cb0efc4cf4cff4a18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:39.356042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d4044221d7468cb0efc4cf4cff4a18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:39.370329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d4044221d7468cb0efc4cf4cff4a18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:39.393745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d4044221d7468cb0efc4cf4cff4a18'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:39.473536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 945/1869] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:39 2022] DELETE /identity/v3/users/67d4044221d7468cb0efc4cf4cff4a18 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:39.479411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:39.479864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:39.479953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:39.536469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:39.538602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:39.674632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 925/1870] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:39.736017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:39.737704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:39.889482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f75cc-7ad7-4169-8572-0302c74e7b89 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:39.893280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:39.893898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:39.894188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:39.894819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:39.933455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:39.937230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:39.980531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 946/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:40.399316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:40.401626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:40.415000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1865d-f546-4f44-9534-83a2f9e2827f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:40.423084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:40.426921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:40.426921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:40.426921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] PATH_INFO: `/v3/users/e36a12ba358d44118adf8dc3e4822a49` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:40.428560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:40.428683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36a12ba358d44118adf8dc3e4822a49)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:40.430087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:40.431561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:40.456187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8743c8-5cbb-420c-a7f9-0c634405cf5f service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:40.470311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:40.471182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:40.471462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:40.472594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] PATH_INFO: `/v3/projects/1c46822c24bc4e5182f55aff8aff6858` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:40.474057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c46822c24bc4e5182f55aff8aff6858)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:40.476224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:40.535737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36a12ba358d44118adf8dc3e4822a49'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.549081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36a12ba358d44118adf8dc3e4822a49'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.550076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36a12ba358d44118adf8dc3e4822a49'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.550960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36a12ba358d44118adf8dc3e4822a49'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.558621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:40.566498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162f1dc2-a0e4-41fc-b25f-ef1d7f48018f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36a12ba358d44118adf8dc3e4822a49'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.582928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c46822c24bc4e5182f55aff8aff6858', 'request_id': 'req-5eec7ad5-3293-41f2-ae21-8233e5de56e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.592754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c46822c24bc4e5182f55aff8aff6858', 'request_id': 'req-5eec7ad5-3293-41f2-ae21-8233e5de56e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.600967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 926/1872] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:40 2022] DELETE /identity/v3/users/e36a12ba358d44118adf8dc3e4822a49 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:40.603413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:40.603413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:40.603638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:40.604374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c46822c24bc4e5182f55aff8aff6858', 'request_id': 'req-5eec7ad5-3293-41f2-ae21-8233e5de56e5'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.635480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] The token cache is being invalidate because project 1c46822c24bc4e5182f55aff8aff6858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:40.635775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.636418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.637612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:40.638227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 947/1873] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:40 2022] DELETE /identity/v3/projects/1c46822c24bc4e5182f55aff8aff6858 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:40.639552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:40.644067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:40.645661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:40.733222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:40.737293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 927/1874] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:40.750697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:40.752954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:40.758778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec7ad5-3293-41f2-ae21-8233e5de56e5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:40.765391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:40.766012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:40.766290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:40.766559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] PATH_INFO: `/v3/users/751c1e1ac1504168b9571d64d6ef2279` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:40.767781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=751c1e1ac1504168b9571d64d6ef2279)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:40.769923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:40.838800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751c1e1ac1504168b9571d64d6ef2279'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.839591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751c1e1ac1504168b9571d64d6ef2279'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.840338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751c1e1ac1504168b9571d64d6ef2279'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.853662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751c1e1ac1504168b9571d64d6ef2279'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.866262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751c1e1ac1504168b9571d64d6ef2279'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:40.891897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca326b-e3d7-4ef0-85ec-2ee77c55f7e8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:40.897960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:40.898686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:40.899980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 948/1875] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:40 2022] DELETE /identity/v3/users/751c1e1ac1504168b9571d64d6ef2279 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:40.900498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:40.900792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:40.906148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:40.920330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:40.921854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:40.932764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 928/1876] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:41.511581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:41.513089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:41.606978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:41.609185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:41.626304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373df6f8-aa0a-4e72-b914-0c63516b11c8 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:41.688037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20303fc-3c85-4182-a030-c6be991994ed admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:41.694614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:41.695386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:41.695667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:41.695938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] PATH_INFO: `/v3/projects/2a1598170a6e48d79ad2cb2a1bb57a24` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:41.697280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1598170a6e48d79ad2cb2a1bb57a24)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:41.699856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:41.746575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:41.747544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:41.748320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:41.748690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] PATH_INFO: `/v3/projects/b36be5ec2e014f8eb19be57206d54e40` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:41.750257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36be5ec2e014f8eb19be57206d54e40)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:41.752397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:41.757401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1598170a6e48d79ad2cb2a1bb57a24', 'request_id': 'req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.764869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1598170a6e48d79ad2cb2a1bb57a24', 'request_id': 'req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.777153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1598170a6e48d79ad2cb2a1bb57a24', 'request_id': 'req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.780278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:41.797749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] The token cache is being invalidate because project 2a1598170a6e48d79ad2cb2a1bb57a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:41.798327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.799183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cb500bcc-83db-4c35-b2d9-a7f92e32fda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.801008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 949/1877] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:41 2022] DELETE /identity/v3/projects/2a1598170a6e48d79ad2cb2a1bb57a24 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:41.806202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff7cd-db53-46bb-90f7-ddad114117cc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:41.806701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff7cd-db53-46bb-90f7-ddad114117cc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:41.807170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff7cd-db53-46bb-90f7-ddad114117cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:41.820806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:41.836824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e13ff7cd-db53-46bb-90f7-ddad114117cc None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:41.838489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e13ff7cd-db53-46bb-90f7-ddad114117cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:41.853163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36be5ec2e014f8eb19be57206d54e40', 'request_id': 'req-59baae00-a08b-4a1a-b1bc-28a0138403a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.864936 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36be5ec2e014f8eb19be57206d54e40', 'request_id': 'req-59baae00-a08b-4a1a-b1bc-28a0138403a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.874890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36be5ec2e014f8eb19be57206d54e40', 'request_id': 'req-59baae00-a08b-4a1a-b1bc-28a0138403a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.895609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] The token cache is being invalidate because project b36be5ec2e014f8eb19be57206d54e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:41.895901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.897727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:41.900457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 929/1878] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:41 2022] DELETE /identity/v3/projects/b36be5ec2e014f8eb19be57206d54e40 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:41.904315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:41.906366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:41.945235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 950/1879] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:41.950048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:41.950292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:41.950596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:41.984900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:41.986201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:41.998887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baae00-a08b-4a1a-b1bc-28a0138403a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.000741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 951/1880] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:42.005240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.009319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.009978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.010260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.010528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] PATH_INFO: `/v3/users/7b06350840814b2685ddba9ad98726b2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.011873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b06350840814b2685ddba9ad98726b2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.013840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.030092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb51c-e80a-4bca-a58e-f9efabff44c1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.037544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.038675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.038957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.039227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.039909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:42.040271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.042368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.061923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 952/1881] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:42.068062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.090157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377cf52-884c-479d-9b4c-bf09ed605de8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.104890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.105314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.105596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.106291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.109695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b06350840814b2685ddba9ad98726b2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.109825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.110533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.115976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b06350840814b2685ddba9ad98726b2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.117179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b06350840814b2685ddba9ad98726b2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.118307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b06350840814b2685ddba9ad98726b2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.131873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b06350840814b2685ddba9ad98726b2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.172585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 953/1882] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:42.176619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.180832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 930/1883] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:41 2022] DELETE /identity/v3/users/7b06350840814b2685ddba9ad98726b2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:42.182503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:42.276760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18baafd-8ef1-4833-8c37-45bc30f843ef admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.341745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.342412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.342659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.342928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.343565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.345575 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.354307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:42.376587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.376963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 954/1884] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:42.388162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55112c83-beac-404d-a677-5aebfdd0f753 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.393604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.394228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.394500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.394773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.395421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.397514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.407863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 931/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:42.412206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.430472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fdef1-685a-494d-8295-f88a55d2e33b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.435569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96f12-3142-4866-a8a2-bfede97f322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.436180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96f12-3142-4866-a8a2-bfede97f322b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.436458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96f12-3142-4866-a8a2-bfede97f322b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.436871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96f12-3142-4866-a8a2-bfede97f322b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.437541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96f12-3142-4866-a8a2-bfede97f322b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.439429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96f12-3142-4866-a8a2-bfede97f322b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.451390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 955/1886] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:42.456562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.470791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4449f-d7f9-4671-aa6b-55beb9915bf2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.477717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.485574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.485988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.486270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] PATH_INFO: `/v3/projects/b247e5c6c7634bbfa7be9229c8ca72dc/users/803605dc9e3f486fad5f551af0087923/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.509226 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b247e5c6c7634bbfa7be9229c8ca72dc, user_id=803605dc9e3f486fad5f551af0087923, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.515243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.520815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:42.545177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 932/1887] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:42 2022] PUT /identity/v3/projects/b247e5c6c7634bbfa7be9229c8ca72dc/users/803605dc9e3f486fad5f551af0087923/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:42.546911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.547268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.547739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.578612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] MFA Rules not processed for user `803605dc9e3f486fad5f551af0087923`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:42.579825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:42.586621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.588281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:42.650903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 956/1888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:42.655323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.658041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11817a-91e3-4769-abab-a6d7e7bd5acd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.663808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.664467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.664893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.665164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] PATH_INFO: `/v3/projects/ba565aaef0634eadbfc3cf5dc5cc977b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.666276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba565aaef0634eadbfc3cf5dc5cc977b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.666564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66afae-284a-4b8f-96fa-1fd0b69d87fe None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.668157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.671305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.671894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.672171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.672441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.673112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.675129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.711367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 957/1889] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:42.712349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.717958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba565aaef0634eadbfc3cf5dc5cc977b', 'request_id': 'req-130f063d-5b96-442c-a19d-5e92831ab788'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.727881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba565aaef0634eadbfc3cf5dc5cc977b', 'request_id': 'req-130f063d-5b96-442c-a19d-5e92831ab788'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.734892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba565aaef0634eadbfc3cf5dc5cc977b', 'request_id': 'req-130f063d-5b96-442c-a19d-5e92831ab788'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.748431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] The token cache is being invalidate because project ba565aaef0634eadbfc3cf5dc5cc977b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:42.748813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.749489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-130f063d-5b96-442c-a19d-5e92831ab788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:42.754970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 933/1890] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:42 2022] DELETE /identity/v3/projects/ba565aaef0634eadbfc3cf5dc5cc977b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:42.756393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.756674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.757684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.780180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:42.780180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:42.796837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af1550-41a3-4107-acce-2e62f705cf3d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.802346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.804008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.804008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.804366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.804710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.806679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.833410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 958/1891] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:42.834731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.836482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:42.851523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414d66-6bf0-432a-9976-01920c371057 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.857776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214107b-114a-4be9-90ca-4331dd197cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.858169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214107b-114a-4be9-90ca-4331dd197cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.858447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214107b-114a-4be9-90ca-4331dd197cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.858805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214107b-114a-4be9-90ca-4331dd197cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.859438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214107b-114a-4be9-90ca-4331dd197cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.861626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214107b-114a-4be9-90ca-4331dd197cf4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.871706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 934/1892] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:42.877474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 959/1893] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:42.878675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.879364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.879719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.880105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.888584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196f1a9-75f8-4edb-ac7b-0387ac5fe571 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.893587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.894376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.894697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.895030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] PATH_INFO: `/v3/projects/b310738535524a8fafa491e22885609d/users/4775d868d3a943849ea5c00bb01da881/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.901074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:42.902474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:42.911129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 960/1894] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:42.919269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b310738535524a8fafa491e22885609d, user_id=4775d868d3a943849ea5c00bb01da881, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.921674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.922403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.934522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ca5d-0bac-4a42-8687-af782682bb3e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:42.942552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:42.943705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:42.943705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:42.944576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:42.945878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:42.945878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:42.948035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:42.972994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 961/1896] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:42.977142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 935/1896] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:42 2022] PUT /identity/v3/projects/b310738535524a8fafa491e22885609d/users/4775d868d3a943849ea5c00bb01da881/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:42.977402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.980647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:42.989701 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:42.991503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:43.001065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04801fc7-5d41-42c5-ab82-a4d6e918330d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.120749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d484d-7318-4030-a254-9c3b5df86be3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.132995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.133701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.133972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.134244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.134886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.140374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.144018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.144941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.145387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.145809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.149325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.152249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.171678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 962/1897] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:43.175880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:43.195509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 936/1898] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:42 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:43.197082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:43.219926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a56ed-7fcf-43b5-b3c2-163f1771d7b9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.340479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4d7d-821d-49c0-b86c-bbc7be5c06bd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.366506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800381-8b6e-4702-a4c4-9ba67c2986b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.367362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800381-8b6e-4702-a4c4-9ba67c2986b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.367789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800381-8b6e-4702-a4c4-9ba67c2986b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.368375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800381-8b6e-4702-a4c4-9ba67c2986b5 admin admin] PATH_INFO: `/v3/projects/b310738535524a8fafa491e22885609d/users/4775d868d3a943849ea5c00bb01da881/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.371144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800381-8b6e-4702-a4c4-9ba67c2986b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b310738535524a8fafa491e22885609d, user_id=4775d868d3a943849ea5c00bb01da881, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.374218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800381-8b6e-4702-a4c4-9ba67c2986b5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.382556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.383192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.383464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.383726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.384358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.386584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.396710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 963/1899] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:43 2022] PUT /identity/v3/projects/b310738535524a8fafa491e22885609d/users/4775d868d3a943849ea5c00bb01da881/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:43.416038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.416329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.416691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.427039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 937/1900] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:43 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:43.431957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:43.443761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebb9fa-7ce2-40c8-bde5-c9ee716d71eb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.487576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] MFA Rules not processed for user `4775d868d3a943849ea5c00bb01da881`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:43.488822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:43.543134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.543762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.544040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.544328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.545147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.555114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.579094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 938/1901] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:43.580545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:43.584961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 964/1902] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:43.597096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:43.599325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:43.602519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba33d1-2bd4-4af2-872e-972545310b53 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.630545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:43.636179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.637245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.637604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.637937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.638658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.640313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.684834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 939/1903] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:43.688417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:43.701686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:43.718305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f2a5-8ecd-4ee5-80db-c02a6420f113 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.721244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcdd3d-f784-4722-8194-c9d7dc7e8776 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:43.729313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4eea-b6b0-44e1-b139-baabc75e3f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.730943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:43.731725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.732118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4eea-b6b0-44e1-b139-baabc75e3f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.732719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4eea-b6b0-44e1-b139-baabc75e3f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.733154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4eea-b6b0-44e1-b139-baabc75e3f55 admin admin] PATH_INFO: `/v3/projects/79d8aee707be4661b2a56e14fae3d0f1/users/fcf90f6bfcf14dd581eec4f54f655753/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.733559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.734245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.738530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:43.775134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4eea-b6b0-44e1-b139-baabc75e3f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d8aee707be4661b2a56e14fae3d0f1, user_id=fcf90f6bfcf14dd581eec4f54f655753, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.782413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4eea-b6b0-44e1-b139-baabc75e3f55 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.830292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 940/1904] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:43 2022] PUT /identity/v3/projects/79d8aee707be4661b2a56e14fae3d0f1/users/fcf90f6bfcf14dd581eec4f54f655753/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:43.843286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:43.843765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:43.844178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:43.906541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:43.908348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:43.921889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 965/1905] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:43.936659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] MFA Rules not processed for user `fcf90f6bfcf14dd581eec4f54f655753`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:43.937914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:44.085080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 941/1906] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:44.089449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.101394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6554-4b3a-42c5-9b33-16cd3b0fe5d7 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.176814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.176814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.176814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.176814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.177241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:44.177241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:44.209522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 966/1907] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:44 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:44.211361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.224389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829293a4-ad06-4dc0-95e6-a64c73f0c0fb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.300066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.300899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.301175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.301656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.302475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:44.305410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:44.331640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 942/1908] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:44 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:44.335923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.350551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a339cf-e8f8-4b68-be56-59f8aee2a09c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.378862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.379654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.380073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.380562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.381792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:44.383275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:44.408033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 967/1909] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:44.413352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.437358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157477-aedd-4979-b4c4-3e6842c3099a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.443824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.443824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.443824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.443824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] PATH_INFO: `/v3/projects/ef245b8e974e44d5b47b216a35a801ed/users/2e897d718853418fa6143e647c7ebc9e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.487091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef245b8e974e44d5b47b216a35a801ed, user_id=2e897d718853418fa6143e647c7ebc9e, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:44.491911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:44.529322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 943/1910] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:44 2022] PUT /identity/v3/projects/ef245b8e974e44d5b47b216a35a801ed/users/2e897d718853418fa6143e647c7ebc9e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:44.529945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.558270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702ada-be2a-40a9-aee4-ee2abf254962 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.654521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:44.674437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccede75e-8bf1-43c2-80c5-b6f41d74590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.675212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccede75e-8bf1-43c2-80c5-b6f41d74590e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.675778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccede75e-8bf1-43c2-80c5-b6f41d74590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.676463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccede75e-8bf1-43c2-80c5-b6f41d74590e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.677347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccede75e-8bf1-43c2-80c5-b6f41d74590e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:44.679700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccede75e-8bf1-43c2-80c5-b6f41d74590e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:44.691002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 968/1911] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:44.695933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.718011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe161b7-3139-48f6-a079-43b903e2580d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.723233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.723982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.724389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.724692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] PATH_INFO: `/v3/projects/ef245b8e974e44d5b47b216a35a801ed/users/2e897d718853418fa6143e647c7ebc9e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.727763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef245b8e974e44d5b47b216a35a801ed, user_id=2e897d718853418fa6143e647c7ebc9e, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:44.730524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:44.741785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 944/1912] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:44 2022] PUT /identity/v3/projects/ef245b8e974e44d5b47b216a35a801ed/users/2e897d718853418fa6143e647c7ebc9e/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:44.754875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a269f-468b-4bba-9379-81c245831025 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.754875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a269f-468b-4bba-9379-81c245831025 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.754875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a269f-468b-4bba-9379-81c245831025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:44.789661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-751a269f-468b-4bba-9379-81c245831025 None None] MFA Rules not processed for user `2e897d718853418fa6143e647c7ebc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:44.790989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-751a269f-468b-4bba-9379-81c245831025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:44.886765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 969/1913] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:44.899183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:44.925216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:44.989038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794db03-815e-4040-933d-7599163a1f73 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:44.997018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:44.997931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:44.998403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:44.998847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:45.010730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:45.012229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:45.028035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 945/1914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:45.271149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a269f-468b-4bba-9379-81c245831025 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:45.273478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-751a269f-468b-4bba-9379-81c245831025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:45.285759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a269f-468b-4bba-9379-81c245831025 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:45.290303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee67f2-60dc-4039-a4ed-9e8633052c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:45.291112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee67f2-60dc-4039-a4ed-9e8633052c24 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:45.291397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee67f2-60dc-4039-a4ed-9e8633052c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:45.291767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee67f2-60dc-4039-a4ed-9e8633052c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:45.361010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee67f2-60dc-4039-a4ed-9e8633052c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:45.362665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee67f2-60dc-4039-a4ed-9e8633052c24 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:45.373147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 970/1915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:45.708822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:45.863182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aadd1c-4d0b-4f6a-8ee6-dea10e8f7561 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:45.909593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:45.910224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:45.910591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:45.910779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] PATH_INFO: `/v3/users/fcf90f6bfcf14dd581eec4f54f655753` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:45.911968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf90f6bfcf14dd581eec4f54f655753)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:45.915254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:46.020531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf90f6bfcf14dd581eec4f54f655753'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:46.039444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf90f6bfcf14dd581eec4f54f655753'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:46.040878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf90f6bfcf14dd581eec4f54f655753'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:46.042954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf90f6bfcf14dd581eec4f54f655753'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:46.061515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf90f6bfcf14dd581eec4f54f655753'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:46.087810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 946/1916] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:45 2022] DELETE /identity/v3/users/fcf90f6bfcf14dd581eec4f54f655753 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:46.106697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:46.106983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:46.107369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:46.136311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:46.137738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:46.300232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 971/1917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:46.312197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:46.313654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:46.380168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:46.398838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a23c5-24c5-4916-bfa8-eae6612e410e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:46.408989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:46.408989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:46.408989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:46.408989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:46.447443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:46.450461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:46.465576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 947/1918] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:47.179715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:47.181424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:47.199407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed75a44-c067-4b5f-bf23-c425951c6fc5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:47.214238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:47.215289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:47.215761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:47.216671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] PATH_INFO: `/v3/projects/79d8aee707be4661b2a56e14fae3d0f1` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:47.217885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d8aee707be4661b2a56e14fae3d0f1)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:47.220333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:47.223522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:47.292496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d8aee707be4661b2a56e14fae3d0f1', 'request_id': 'req-45dd0098-0824-4992-8d71-a18e6b0d3ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.299889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d8aee707be4661b2a56e14fae3d0f1', 'request_id': 'req-45dd0098-0824-4992-8d71-a18e6b0d3ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.309314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d8aee707be4661b2a56e14fae3d0f1', 'request_id': 'req-45dd0098-0824-4992-8d71-a18e6b0d3ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.325543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] The token cache is being invalidate because project 79d8aee707be4661b2a56e14fae3d0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:47.325830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.326520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.328317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 972/1919] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:47 2022] DELETE /identity/v3/projects/79d8aee707be4661b2a56e14fae3d0f1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:47.332330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:47.356421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbabe9a-3173-48fd-b86c-f614f5d5047c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:47.422044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:47.422683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:47.422966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:47.423233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] PATH_INFO: `/v3/users/2e897d718853418fa6143e647c7ebc9e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:47.424405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e897d718853418fa6143e647c7ebc9e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:47.426689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:47.484132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e897d718853418fa6143e647c7ebc9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.492571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e897d718853418fa6143e647c7ebc9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.493286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e897d718853418fa6143e647c7ebc9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.493899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e897d718853418fa6143e647c7ebc9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.506794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b42ae0f-3c03-4543-86fb-d07ef19d1782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e897d718853418fa6143e647c7ebc9e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:47.534705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 948/1920] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:47 2022] DELETE /identity/v3/users/2e897d718853418fa6143e647c7ebc9e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:47.923604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:47.925588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:47.947253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd0098-0824-4992-8d71-a18e6b0d3ea1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.029379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.032664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.032982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.033257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] PATH_INFO: `/v3/projects/ef245b8e974e44d5b47b216a35a801ed` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.034499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef245b8e974e44d5b47b216a35a801ed)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.038347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.091237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef245b8e974e44d5b47b216a35a801ed', 'request_id': 'req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:48.097869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef245b8e974e44d5b47b216a35a801ed', 'request_id': 'req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:48.104481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef245b8e974e44d5b47b216a35a801ed', 'request_id': 'req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:48.118629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] The token cache is being invalidate because project ef245b8e974e44d5b47b216a35a801ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:48.118922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:48.119602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-41f3c0a4-4f6d-4ae5-83cc-790d3b079f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:48.121287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 973/1921] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:47 2022] DELETE /identity/v3/projects/ef245b8e974e44d5b47b216a35a801ed => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:48.125956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.126252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.126652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.157798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:48.161442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:48.247898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 949/1922] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:48.256397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.256397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.256397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.281458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:48.282729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:48.297187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 974/1923] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:48.301455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.309945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:48.316900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e22dbd-3841-4f24-88a3-bac2e77b3a4f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.325815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.326457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.326747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.327590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.328626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:48.329015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.330709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.343928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 950/1924] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:48.348294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.359835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c48965-6f6d-41b8-8ba5-03c6e39288d6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.365465 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.366300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.366775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.367231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.368072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.370613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.407644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:48.432433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.433427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 975/1925] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:48 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:48.444951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574dc39-5388-499e-a847-634ec0195eee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.515956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.516329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.516736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.517011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.517948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.520086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.558999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 951/1926] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:48 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:48.564024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.600197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb997e-0da1-45bb-b4ea-c5583f55b0f9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.606616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.607367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.607747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.608087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.608967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.611857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.628690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 976/1927] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:48.641491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.666300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d463-fe59-48ac-9bb4-e325a3f0b132 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.670886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.673219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:48.684562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.685268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.685562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.685881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.686768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.689480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.705866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 952/1928] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:48.710734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.729251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75cf0-075c-4711-b993-3cd6cccfeac7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.736653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b60423-6e82-4e7e-b396-1d30b67ef91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.737357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60423-6e82-4e7e-b396-1d30b67ef91b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.737688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60423-6e82-4e7e-b396-1d30b67ef91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.737969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b60423-6e82-4e7e-b396-1d30b67ef91b admin admin] PATH_INFO: `/v3/projects/d2aa707f4cbd46b9b222e00a3cadc465/users/8125e1d6daa44b98b6ae5163fd7a2efe/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.753841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5470-8014-4625-8d53-aa4bd0571560 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:48.757808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60423-6e82-4e7e-b396-1d30b67ef91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aa707f4cbd46b9b222e00a3cadc465, user_id=8125e1d6daa44b98b6ae5163fd7a2efe, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.759572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:48.760670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.761040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.761379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.762012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b60423-6e82-4e7e-b396-1d30b67ef91b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.764007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:48.780215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 953/1929] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:48 2022] PUT /identity/v3/projects/d2aa707f4cbd46b9b222e00a3cadc465/users/8125e1d6daa44b98b6ae5163fd7a2efe/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:48.792066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:48.792375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:48.792631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:48.846091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] MFA Rules not processed for user `8125e1d6daa44b98b6ae5163fd7a2efe`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:48.847344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:48.855950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:48.857571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:48.873948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 977/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:48.923000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 954/1931] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:48.934309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:48.935763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:48.948789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f3433-2dd0-492d-aeba-1697474703ed service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:49.018158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc636-d4a6-4ca5-a3c7-9c181d554b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:49.018906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc636-d4a6-4ca5-a3c7-9c181d554b8d service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:49.019278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc636-d4a6-4ca5-a3c7-9c181d554b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:49.019555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc636-d4a6-4ca5-a3c7-9c181d554b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:49.032314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fc636-d4a6-4ca5-a3c7-9c181d554b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:49.034060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fc636-d4a6-4ca5-a3c7-9c181d554b8d service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:49.047015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 978/1932] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:50.948977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:50.952578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:51.039348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:51.090740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6d12-ec35-459e-8dc4-b1538c774899 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:51.103319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:51.104258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:51.104692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:51.105749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] PATH_INFO: `/v3/users/0671e7751dd940aea015acc93611d3e7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:51.107661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0671e7751dd940aea015acc93611d3e7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:51.110115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:51.174557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0671e7751dd940aea015acc93611d3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:51.183606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0671e7751dd940aea015acc93611d3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:51.184392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0671e7751dd940aea015acc93611d3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:51.185152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0671e7751dd940aea015acc93611d3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:51.201530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0671e7751dd940aea015acc93611d3e7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:51.229042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 955/1933] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:50 2022] DELETE /identity/v3/users/0671e7751dd940aea015acc93611d3e7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:51.230753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:51.231232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:51.231314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:51.260836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:51.262092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:51.295451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:51.350881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 979/1934] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:51.368436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:51.370194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:51.442507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80157f5-ef34-40a7-b3b3-9dd9d78cd839 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:51.447863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585528a8-6f96-4914-89a2-f4364f052a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:51.448578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585528a8-6f96-4914-89a2-f4364f052a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:51.448961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585528a8-6f96-4914-89a2-f4364f052a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:51.449300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585528a8-6f96-4914-89a2-f4364f052a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:51.465994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585528a8-6f96-4914-89a2-f4364f052a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:51.467710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585528a8-6f96-4914-89a2-f4364f052a98 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:51.478894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 956/1935] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:52.466730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:52.468157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:52.481559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a8ba-a65b-4870-9e60-03835abb6ad5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:52.490920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:52.492065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:52.492065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:52.492065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] PATH_INFO: `/v3/projects/803f0a46b7f24b2a8f869640668190ee` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:52.497319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803f0a46b7f24b2a8f869640668190ee)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:52.500723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:52.584803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803f0a46b7f24b2a8f869640668190ee', 'request_id': 'req-b323f03f-9e40-4e2e-9a12-56fe7260fc68'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:52.613519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803f0a46b7f24b2a8f869640668190ee', 'request_id': 'req-b323f03f-9e40-4e2e-9a12-56fe7260fc68'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:52.628051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803f0a46b7f24b2a8f869640668190ee', 'request_id': 'req-b323f03f-9e40-4e2e-9a12-56fe7260fc68'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:52.671750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] The token cache is being invalidate because project 803f0a46b7f24b2a8f869640668190ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:52.672140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:52.674112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b323f03f-9e40-4e2e-9a12-56fe7260fc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:52.676203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 980/1936] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:52 2022] DELETE /identity/v3/projects/803f0a46b7f24b2a8f869640668190ee => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:52.681590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:52.682436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:52.682910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:52.716533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:52.720630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:52.844572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:52.902307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 957/1937] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:52.910280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:52.911127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:52.911127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:52.959406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:52.965323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:52.974157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 981/1938] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:52.980388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:52.996179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666eaba-5bb2-4626-a9dd-5ade49633c96 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.016113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.016909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.017314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.018803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.019569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:53.020400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.024063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.068840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 958/1939] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:23:53.071898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:53.089805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421489-fbe6-4279-b8b6-08665a68950f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.110156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.111063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.111553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.112013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.112826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.115445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.170659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 982/1940] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:53 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:53.174856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:53.187616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00f65-08d4-4fe9-848f-5b56c13a305b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.278741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.279541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.279957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.280331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.281920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.283976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.324914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 959/1941] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:53 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:53.329812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:53.349365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45481-52d0-4414-9932-b08a76f31165 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.355838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.356467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.356746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.357106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.357744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.359352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.380027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 983/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:53.384895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:53.396136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234edd7-be51-4305-a78f-a9029c5b9d8d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.403696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dffe0e-3946-4795-8b20-6011fa4c57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.404730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dffe0e-3946-4795-8b20-6011fa4c57d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.405260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dffe0e-3946-4795-8b20-6011fa4c57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.405815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dffe0e-3946-4795-8b20-6011fa4c57d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.406537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dffe0e-3946-4795-8b20-6011fa4c57d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.408479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dffe0e-3946-4795-8b20-6011fa4c57d9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.424529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 960/1943] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:53.425777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:53.437452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775db535-7418-4c39-82af-806c1ec437da admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.449797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.450780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.451218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.451643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] PATH_INFO: `/v3/projects/4adb8cd2a2ca45ef9b539ffe6b55a8c5/users/4a9ee28b7fd744a297ceab5c06f74ea1/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.472605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adb8cd2a2ca45ef9b539ffe6b55a8c5, user_id=4a9ee28b7fd744a297ceab5c06f74ea1, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.476648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.496147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 984/1944] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:53 2022] PUT /identity/v3/projects/4adb8cd2a2ca45ef9b539ffe6b55a8c5/users/4a9ee28b7fd744a297ceab5c06f74ea1/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:53.506997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54026-17d7-4654-a748-a573be55e394 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.507315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54026-17d7-4654-a748-a573be55e394 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.507591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e54026-17d7-4654-a748-a573be55e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.573312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-72e54026-17d7-4654-a748-a573be55e394 None None] MFA Rules not processed for user `4a9ee28b7fd744a297ceab5c06f74ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:53.574547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-72e54026-17d7-4654-a748-a573be55e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:53.650125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 961/1945] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:53.666970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:53.667751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:53.798290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9290-f4e7-4db7-8fc3-ef91ba128322 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:53.812055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b6da-e7e3-457e-a4f1-4d297c0d7d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:53.812808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b6da-e7e3-457e-a4f1-4d297c0d7d09 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:53.813204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b6da-e7e3-457e-a4f1-4d297c0d7d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:53.813580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b6da-e7e3-457e-a4f1-4d297c0d7d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:53.836743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b6da-e7e3-457e-a4f1-4d297c0d7d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:53.839244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b6da-e7e3-457e-a4f1-4d297c0d7d09 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:53.843333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:53.856937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 985/1946] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:54.195992 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54026-17d7-4654-a748-a573be55e394 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:54.199489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-72e54026-17d7-4654-a748-a573be55e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:54.353951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:54.378293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e54026-17d7-4654-a748-a573be55e394 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:54.384996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:54.385817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:54.386266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:54.386635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] PATH_INFO: `/v3/users/803605dc9e3f486fad5f551af0087923` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:54.388050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803605dc9e3f486fad5f551af0087923)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:54.390185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:54.458996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803605dc9e3f486fad5f551af0087923'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:54.469273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803605dc9e3f486fad5f551af0087923'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:54.470415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803605dc9e3f486fad5f551af0087923'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:54.471033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803605dc9e3f486fad5f551af0087923'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:54.482306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803605dc9e3f486fad5f551af0087923'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:54.503219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 962/1947] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:54 2022] DELETE /identity/v3/users/803605dc9e3f486fad5f551af0087923 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:54.508547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:54.509178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:54.509178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:54.530514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:54.531913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:54.620833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 986/1948] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:54.638954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:54.640817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:54.789044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7d33-275e-403e-9657-f95a00ee1386 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:54.804383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713d9e-89ae-4422-8d47-32dbf492b1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:54.805388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713d9e-89ae-4422-8d47-32dbf492b1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:54.805868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713d9e-89ae-4422-8d47-32dbf492b1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:54.806415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713d9e-89ae-4422-8d47-32dbf492b1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:54.823017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7713d9e-89ae-4422-8d47-32dbf492b1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:54.824650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7713d9e-89ae-4422-8d47-32dbf492b1f8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:54.836672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 963/1949] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:55.143359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:55.144976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:55.157765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1186029-478b-40a9-9c1f-3dfa43761061 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:55.163448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:55.164084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:55.164481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:55.164754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] PATH_INFO: `/v3/users/8125e1d6daa44b98b6ae5163fd7a2efe` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:55.165904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8125e1d6daa44b98b6ae5163fd7a2efe)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:55.167824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:55.244680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8125e1d6daa44b98b6ae5163fd7a2efe'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:55.246299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8125e1d6daa44b98b6ae5163fd7a2efe'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:55.247195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8125e1d6daa44b98b6ae5163fd7a2efe'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:55.265412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8125e1d6daa44b98b6ae5163fd7a2efe'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:55.280358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8125e1d6daa44b98b6ae5163fd7a2efe'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:55.310018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 987/1950] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:55 2022] DELETE /identity/v3/users/8125e1d6daa44b98b6ae5163fd7a2efe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:55.314547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:55.315041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:55.315131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:55.385924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:55.387288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:55.514400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 964/1951] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:55.556058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:55.565313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:55.736547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cfae1-0c1e-4101-8131-6d2e3e7a05ec admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:55.757832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:55.758901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:55.759692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:55.760313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:55.788841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:55.791452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:55.826994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 988/1952] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:55.873994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:55.875668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:55.907007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498a90-33de-4635-b4d0-19f04f4a8185 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:55.917876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:55.918529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:55.918815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:55.919212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] PATH_INFO: `/v3/projects/b247e5c6c7634bbfa7be9229c8ca72dc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:55.921256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b247e5c6c7634bbfa7be9229c8ca72dc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:55.923509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:55.949949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:56.029082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b247e5c6c7634bbfa7be9229c8ca72dc', 'request_id': 'req-b585272c-93ad-4a93-9637-2973b264edaa'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.049190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b247e5c6c7634bbfa7be9229c8ca72dc', 'request_id': 'req-b585272c-93ad-4a93-9637-2973b264edaa'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.060626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b247e5c6c7634bbfa7be9229c8ca72dc', 'request_id': 'req-b585272c-93ad-4a93-9637-2973b264edaa'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.087763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] The token cache is being invalidate because project b247e5c6c7634bbfa7be9229c8ca72dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:56.088122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.088787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.091386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 965/1953] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:55 2022] DELETE /identity/v3/projects/b247e5c6c7634bbfa7be9229c8ca72dc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:56.095816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:56.110580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c369-de30-4ebe-a67f-1cb234fc849c service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:56.131664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:56.202067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:56.205760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:56.205760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:56.205760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] PATH_INFO: `/v3/users/4775d868d3a943849ea5c00bb01da881` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:56.205760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4775d868d3a943849ea5c00bb01da881)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:56.207664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:56.291710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4775d868d3a943849ea5c00bb01da881'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.292845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4775d868d3a943849ea5c00bb01da881'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.293633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4775d868d3a943849ea5c00bb01da881'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.310963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4775d868d3a943849ea5c00bb01da881'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.321572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4775d868d3a943849ea5c00bb01da881'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.345084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 989/1954] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:56 2022] DELETE /identity/v3/users/4775d868d3a943849ea5c00bb01da881 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:56.717901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:56.720007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:56.756307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585272c-93ad-4a93-9637-2973b264edaa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:56.845426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:56.847265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:56.859976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:56.860757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:56.861195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:56.861562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] PATH_INFO: `/v3/projects/d2aa707f4cbd46b9b222e00a3cadc465` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:56.863024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2aa707f4cbd46b9b222e00a3cadc465)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:56.865487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:56.944024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2aa707f4cbd46b9b222e00a3cadc465', 'request_id': 'req-f97a1f85-39f3-4df1-9764-ce423aec3f2b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.945526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507eec0-8f4e-4dd8-83ba-d0e32647477c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:56.954948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2aa707f4cbd46b9b222e00a3cadc465', 'request_id': 'req-f97a1f85-39f3-4df1-9764-ce423aec3f2b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.966552 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2aa707f4cbd46b9b222e00a3cadc465', 'request_id': 'req-f97a1f85-39f3-4df1-9764-ce423aec3f2b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.981032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] The token cache is being invalidate because project d2aa707f4cbd46b9b222e00a3cadc465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:56.981389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.982158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f97a1f85-39f3-4df1-9764-ce423aec3f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:56.987674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 966/1955] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:56 2022] DELETE /identity/v3/projects/d2aa707f4cbd46b9b222e00a3cadc465 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:56.990065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b747b-fb0f-44c7-a9c6-32b68f86d865 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:56.990286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b747b-fb0f-44c7-a9c6-32b68f86d865 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:56.990564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b747b-fb0f-44c7-a9c6-32b68f86d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.003036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:57.025137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-507b747b-fb0f-44c7-a9c6-32b68f86d865 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:57.026824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-507b747b-fb0f-44c7-a9c6-32b68f86d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.029768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.030539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.030915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.031277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] PATH_INFO: `/v3/users/4a9ee28b7fd744a297ceab5c06f74ea1` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.032542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9ee28b7fd744a297ceab5c06f74ea1)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.034869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.037502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 967/1956] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:57.046501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.046773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.047189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.071647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:57.073056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.084166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 968/1957] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:57.089089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.101044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a33a9-3e5c-4761-8352-7a4bbb090621 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.107119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.107922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.108344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.109142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.110112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:57.110536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.112798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.120223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9ee28b7fd744a297ceab5c06f74ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.121390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9ee28b7fd744a297ceab5c06f74ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.122123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9ee28b7fd744a297ceab5c06f74ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.132311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 969/1958] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:57.134370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.136964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.139024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9ee28b7fd744a297ceab5c06f74ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.147289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:57.153251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-240b069e-9e8a-4aed-8543-9cd2e969f552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9ee28b7fd744a297ceab5c06f74ea1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.156426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e18bc-f50d-47b7-9f72-94829ba44e4a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.163092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.164064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.164484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.165067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.166153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.168423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.180829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 990/1959] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:23:56 2022] DELETE /identity/v3/users/4a9ee28b7fd744a297ceab5c06f74ea1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:57.184534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.184842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.185120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.211624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:57.213375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.221835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 970/1960] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:57.226399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.322654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 991/1961] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:57.326900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1adc52-fd2d-43b5-89fc-20c1facf5e95 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.332377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.333132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.333530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.333862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.334809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.336925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.359137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.362049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.368182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 971/1962] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:57.374242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.413363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e81a29-5efe-46ca-aaad-f3f3b3526b0a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.422822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.423507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.423858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.424186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.425048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.426785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.439852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 972/1963] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:57.439852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.439852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.460245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ecdbe-96bd-4fdf-b338-7b0b1248c066 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.465516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.466345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.466691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.467028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] PATH_INFO: `/v3/projects/b310738535524a8fafa491e22885609d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.468598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b310738535524a8fafa491e22885609d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.470969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.488370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7724c-f3a7-4399-999d-963241132513 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.510073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:57.567325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b310738535524a8fafa491e22885609d', 'request_id': 'req-f71e1144-1d5f-498f-8e06-eb1391d316a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.581436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.582307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.582622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.582895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.585450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b310738535524a8fafa491e22885609d', 'request_id': 'req-f71e1144-1d5f-498f-8e06-eb1391d316a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.596193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b310738535524a8fafa491e22885609d', 'request_id': 'req-f71e1144-1d5f-498f-8e06-eb1391d316a2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.601555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.603390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.621655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 992/1964] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:23:57.622566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.623105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] The token cache is being invalidate because project b310738535524a8fafa491e22885609d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:57.623597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.624329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f71e1144-1d5f-498f-8e06-eb1391d316a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:57.632078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 973/1965] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:57 2022] DELETE /identity/v3/projects/b310738535524a8fafa491e22885609d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:57.634296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510df5b8-83b1-4ee2-93e4-34de5517644e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.634643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510df5b8-83b1-4ee2-93e4-34de5517644e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.635243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510df5b8-83b1-4ee2-93e4-34de5517644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.637531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047687-f5c1-404b-968d-5af0db5cc16a service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.670716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-510df5b8-83b1-4ee2-93e4-34de5517644e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:57.674452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-510df5b8-83b1-4ee2-93e4-34de5517644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.802892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:57.813847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.814604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.814885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.815171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.815833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.818962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.842251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 993/1966] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:57.852996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.859170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.876670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 974/1967] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:57.888897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.889444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.889720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.896516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e242f-e276-4b06-a002-604c0db22a2e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:57.902907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d342bb-6c27-4dd0-9f3a-362c3d902d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:57.903804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d342bb-6c27-4dd0-9f3a-362c3d902d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.904223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d342bb-6c27-4dd0-9f3a-362c3d902d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.904632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d342bb-6c27-4dd0-9f3a-362c3d902d46 admin admin] PATH_INFO: `/v3/projects/4968742e63b8445abc6dd2fdaeef65f7/users/f8149c62b4d047ff8b768f92caf61d0a/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.922006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:57.923296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:57.924920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d342bb-6c27-4dd0-9f3a-362c3d902d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4968742e63b8445abc6dd2fdaeef65f7, user_id=f8149c62b4d047ff8b768f92caf61d0a, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:57.929362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d342bb-6c27-4dd0-9f3a-362c3d902d46 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:57.936731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 975/1968] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:57.938820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:57.953837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 994/1969] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:57 2022] PUT /identity/v3/projects/4968742e63b8445abc6dd2fdaeef65f7/users/f8149c62b4d047ff8b768f92caf61d0a/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:57.967723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:57.968682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:57.969114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:57.973473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2102-19aa-4fa4-931f-dbd450658878 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.034598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] MFA Rules not processed for user `f8149c62b4d047ff8b768f92caf61d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:58.035967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:58.117058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.117693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.117970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.118235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.118887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:58.119184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.120807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.149289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 976/1970] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:58.153591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.164905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab334729-e966-4e5b-8f5e-e2ac15a616e7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.169018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 995/1971] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:58.173327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.174060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.174676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.174970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.176590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.180447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.181720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.183499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:58.214761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:58.220878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 977/1972] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:58.226737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.269052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849792d3-a33d-46e4-963f-67e11f0f8ed9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.366355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13919-8a35-42cf-b4e8-e9f82b0de240 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.372548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.373208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.373485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.373845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.377635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.378856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.384152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.384573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.385371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.389478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.448384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 978/1973] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:58 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:58.454864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.495278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24246-4644-49af-bd4b-06807c021898 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.510624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.511970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.512451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.512985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.514114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.516828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.518632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.520289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.540852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 996/1974] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:23:58.542566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.548369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:58.556820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 979/1975] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:58.564852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.587947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae6cc7-8007-45a6-a2ac-e250ff02a9f9 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.594065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.594957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.595381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.596438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] PATH_INFO: `/v3/projects/4adb8cd2a2ca45ef9b539ffe6b55a8c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.597834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adb8cd2a2ca45ef9b539ffe6b55a8c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.599616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6d746-6053-4838-9982-00210f83f0ac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.602236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.617547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.618308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.618685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.619052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.619808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.621591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.646325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 980/1976] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:58.655066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:58.679741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d7b5-44dc-4bd8-9827-88aaabde387f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:58.716963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:58.720470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adb8cd2a2ca45ef9b539ffe6b55a8c5', 'request_id': 'req-3fe09eca-39ad-4fd8-b420-27a50eabd94a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:58.735591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adb8cd2a2ca45ef9b539ffe6b55a8c5', 'request_id': 'req-3fe09eca-39ad-4fd8-b420-27a50eabd94a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:58.752604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adb8cd2a2ca45ef9b539ffe6b55a8c5', 'request_id': 'req-3fe09eca-39ad-4fd8-b420-27a50eabd94a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:58.789330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] The token cache is being invalidate because project 4adb8cd2a2ca45ef9b539ffe6b55a8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:23:58.789725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:58.791356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3fe09eca-39ad-4fd8-b420-27a50eabd94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:23:58.800689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a1635-b890-452f-841d-65eab57360df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:58.802992 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a1635-b890-452f-841d-65eab57360df admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.802992 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a1635-b890-452f-841d-65eab57360df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.803636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a1635-b890-452f-841d-65eab57360df admin admin] PATH_INFO: `/v3/projects/6b38019e05f4424ea00db7cf029555d9/users/a2fcaf6cdc6a480fb045dab5db6af18e/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.808603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 997/1977] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:23:58 2022] DELETE /identity/v3/projects/4adb8cd2a2ca45ef9b539ffe6b55a8c5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:58.813832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ebad-c1dc-4ebe-8619-6ecc64ae380c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.815702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ebad-c1dc-4ebe-8619-6ecc64ae380c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.815992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ebad-c1dc-4ebe-8619-6ecc64ae380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.827094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a1635-b890-452f-841d-65eab57360df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b38019e05f4424ea00db7cf029555d9, user_id=a2fcaf6cdc6a480fb045dab5db6af18e, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:58.830298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a1635-b890-452f-841d-65eab57360df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:58.860330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 981/1978] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:58 2022] PUT /identity/v3/projects/6b38019e05f4424ea00db7cf029555d9/users/a2fcaf6cdc6a480fb045dab5db6af18e/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:23:58.874145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:58.874406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:58.874746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:58.876391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0277ebad-c1dc-4ebe-8619-6ecc64ae380c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:58.877651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0277ebad-c1dc-4ebe-8619-6ecc64ae380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:58.906085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:58.913982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] MFA Rules not processed for user `a2fcaf6cdc6a480fb045dab5db6af18e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:58.916247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:59.024523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 998/1979] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:59.032823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.035293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.036138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.069664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 982/1980] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:23:59.071102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.073418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:59.084187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:59.087054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:59.094030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7de10d-7114-4341-be16-c79a569d1c60 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.100950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.102228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.102667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.104082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.105355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.108094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.114083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 999/1981] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:59.116474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.140822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42ca9-518b-4a53-a0ad-7e2217dff10d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.147383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.148018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.148298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.148570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.149269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:23:59.149567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.151186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.177369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 983/1982] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:59.182831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1000/1983] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:23:59.187066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.187247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.202193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3778b8-c018-4652-8c70-7bf3f56501ff admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.316102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.316835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.317205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.318461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.318926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.321719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.374344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bc28a-9110-4121-af63-22606c315b81 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.376751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1001/1984] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:59.382115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.392008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:59.466929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.467700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.468071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.468451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.469665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.471359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.506855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 984/1985] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:23:59.512578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.525885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c98d04-4de9-41e2-b227-0d0fd81666f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.526377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88060-f8a2-424f-b46f-ab1ccfea9673 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.531589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.532196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.532472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.532640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.532763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.533542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.533780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.534141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.534515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.535282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.535497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.538473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.553646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 985/1986] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:59.554956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.565996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb70e8-34e9-4d63-be6b-e47943498413 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.569024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1002/1987] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:23:59.573357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.574355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.574979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.575261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.575565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.576244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.578177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.586587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb31893-88c5-478f-a014-4deb234010e2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.590084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 986/1988] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:59.595589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.595867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.596560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.596990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.597345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.598022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.600671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.603053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:59.611170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dae0a-f5ad-493a-96bb-0791d47907c5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.612867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1003/1989] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:23:59.617502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.620354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68254dcd-f877-47cd-9ceb-46b4189f683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.621128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68254dcd-f877-47cd-9ceb-46b4189f683d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.621413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68254dcd-f877-47cd-9ceb-46b4189f683d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.621689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68254dcd-f877-47cd-9ceb-46b4189f683d admin admin] PATH_INFO: `/v3/projects/46fe8aeed073427a93522c8ec1375938/users/70fa97af65df4f2391928296ca615bd9/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.627682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cde01a-c8ab-4d8f-84c7-93ba05be44fc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.633585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.634456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.634692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.635058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.635979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.637671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.638491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68254dcd-f877-47cd-9ceb-46b4189f683d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe8aeed073427a93522c8ec1375938, user_id=70fa97af65df4f2391928296ca615bd9, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.641377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68254dcd-f877-47cd-9ceb-46b4189f683d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.649644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1004/1990] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:23:59.653813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.656110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 987/1991] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:59 2022] PUT /identity/v3/projects/46fe8aeed073427a93522c8ec1375938/users/70fa97af65df4f2391928296ca615bd9/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:59.666856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.667362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.667713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.669846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fb288-f9a8-45be-a1b2-0c401b0bf6a3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.704604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] MFA Rules not processed for user `70fa97af65df4f2391928296ca615bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:59.706519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:59.753239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff0fd-18dc-47e1-9c5c-bc2510e19dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.754137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff0fd-18dc-47e1-9c5c-bc2510e19dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.754523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff0fd-18dc-47e1-9c5c-bc2510e19dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.754863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff0fd-18dc-47e1-9c5c-bc2510e19dc4 admin admin] PATH_INFO: `/v3/projects/4235e23e400e4384a0fc93adf8f8a40f/users/35c1b00ce07b4543bd9877ddf0186594/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.778093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff0fd-18dc-47e1-9c5c-bc2510e19dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4235e23e400e4384a0fc93adf8f8a40f, user_id=35c1b00ce07b4543bd9877ddf0186594, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.781141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff0fd-18dc-47e1-9c5c-bc2510e19dc4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.814551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1005/1992] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:23:59 2022] PUT /identity/v3/projects/4235e23e400e4384a0fc93adf8f8a40f/users/35c1b00ce07b4543bd9877ddf0186594/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:23:59.816173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.816455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.816718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.841086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 988/1993] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:23:59.842332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:23:59.856838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df862c-1970-4f03-80a7-f70f835b1cab None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:23:59.857545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] MFA Rules not processed for user `35c1b00ce07b4543bd9877ddf0186594`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:23:59.858814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:23:59.934626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:59.954296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:23:59.954791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:23:59.955141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:23:59.955516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:23:59.956368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:23:59.959994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:23:59.993243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1006/1994] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:00.000760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 989/1995] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:23:59 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:00.002402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.006972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.009203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:00.023070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287435a-0f32-48b5-8a61-bd861ce35d8a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.096233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060441-9bb3-46dc-b37e-ed098ae22dde admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.101603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.102237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.102517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.102790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.107849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.108869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.109323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.109819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.110738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:00.112958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:00.123082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:00.144894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1007/1996] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:00 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:00.146142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.159733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9c193-97c2-40d7-b8d0-853d10d4c30a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.165211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.166068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.166440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.166738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.167505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:00.169161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:00.173736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:00.175321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:00.184512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1008/1997] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:00.185838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.189166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 990/1998] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:00.197169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c2049-86c3-412e-a281-db6c0ffc4734 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.202230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.203418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.203766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.204101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] PATH_INFO: `/v3/projects/f240067e649349c88635624398775f0e/users/0dd62141886c4ea2a28fab64d393e502/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.231138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f240067e649349c88635624398775f0e, user_id=0dd62141886c4ea2a28fab64d393e502, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:00.234499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:00.255053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1009/1999] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:00 2022] PUT /identity/v3/projects/f240067e649349c88635624398775f0e/users/0dd62141886c4ea2a28fab64d393e502/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:00.261432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.283216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb02c-ae93-4770-83ba-e5659d82210b service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.402741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c9b2-9800-4d2a-b897-143bb4f8ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.403540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c9b2-9800-4d2a-b897-143bb4f8ecde admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.403958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c9b2-9800-4d2a-b897-143bb4f8ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.404376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c9b2-9800-4d2a-b897-143bb4f8ecde admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.405266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927c9b2-9800-4d2a-b897-143bb4f8ecde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:00.411281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927c9b2-9800-4d2a-b897-143bb4f8ecde admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:00.442119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.453881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036146f-5c47-4fc9-81f1-9f1e7c1ab27c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.454799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 991/2000] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:00.459541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.460219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.460494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.460762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] PATH_INFO: `/v3/projects/f240067e649349c88635624398775f0e/users/0dd62141886c4ea2a28fab64d393e502/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.462752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f240067e649349c88635624398775f0e, user_id=0dd62141886c4ea2a28fab64d393e502, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:00.465488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:00.500674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.500985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.501254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:00.504125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1010/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:00 2022] PUT /identity/v3/projects/f240067e649349c88635624398775f0e/users/0dd62141886c4ea2a28fab64d393e502/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:00.580290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] MFA Rules not processed for user `0dd62141886c4ea2a28fab64d393e502`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:00.582817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:00.607047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:00.712267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 992/2002] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:00.820233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:00.823293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:00.948229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7505-7b4d-451a-a866-c6295e780d20 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:00.955700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:00.956609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:00.957073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:00.957561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:01.063566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:01.065180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:01.078633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1011/2003] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:02.671887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:02.673655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:02.786319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:02.802085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093324-910a-43e8-8611-42acef1e709c service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.809720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8708d3-8e75-4742-b819-130edf01038c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:02.809720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8708d3-8e75-4742-b819-130edf01038c service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.810019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8708d3-8e75-4742-b819-130edf01038c service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.810534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8708d3-8e75-4742-b819-130edf01038c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.819343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56fdd2-6775-4904-8f35-21458a14c46e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.838177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:02.839122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.839628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.840102 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] PATH_INFO: `/v3/users/f8149c62b4d047ff8b768f92caf61d0a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.841565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8149c62b4d047ff8b768f92caf61d0a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:02.843780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:02.918334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8149c62b4d047ff8b768f92caf61d0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.925971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8149c62b4d047ff8b768f92caf61d0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.926713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8149c62b4d047ff8b768f92caf61d0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.927760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8149c62b4d047ff8b768f92caf61d0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.931355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:02.935282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8708d3-8e75-4742-b819-130edf01038c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:02.936365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d34f62a-0597-4f1f-9f66-57f932bf587a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8149c62b4d047ff8b768f92caf61d0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:02.937321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8708d3-8e75-4742-b819-130edf01038c service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:02.949200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1012/2004] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:02.950491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb474ee-00e7-499a-966d-b73fe4d4a8fa None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.950775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb474ee-00e7-499a-966d-b73fe4d4a8fa None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.951047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb474ee-00e7-499a-966d-b73fe4d4a8fa None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.954188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1013/2005] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:24:02.954772 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb474ee-00e7-499a-966d-b73fe4d4a8fa None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:02.962577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-deb474ee-00e7-499a-966d-b73fe4d4a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:02.972422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 993/2006] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:02 2022] DELETE /identity/v3/users/f8149c62b4d047ff8b768f92caf61d0a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:02.972422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd4b9-0d4a-4069-a30a-a8c95f84e16b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:02.972422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd4b9-0d4a-4069-a30a-a8c95f84e16b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:02.972422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacd4b9-0d4a-4069-a30a-a8c95f84e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:02.989149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb474ee-00e7-499a-966d-b73fe4d4a8fa None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:02.994728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2aacd4b9-0d4a-4069-a30a-a8c95f84e16b None None] MFA Rules not processed for user `5cb077a5cb994974a54ee83240ddb0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:02.996033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2aacd4b9-0d4a-4069-a30a-a8c95f84e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.020189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:03.064895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.065535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.065813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.066091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] PATH_INFO: `/v3/users/c0c517b3f34d440ca41ce746c175319f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.067272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c517b3f34d440ca41ce746c175319f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.069489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.089570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 994/2007] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:03.091466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.092294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.092294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.124743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:03.126044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.128170 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c517b3f34d440ca41ce746c175319f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.128894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c517b3f34d440ca41ce746c175319f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.129492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c517b3f34d440ca41ce746c175319f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.134658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 995/2008] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:03.135272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.136629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.140810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c517b3f34d440ca41ce746c175319f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.150320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c517b3f34d440ca41ce746c175319f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.152629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca90e-4dfc-48ac-a14b-723d06bdecab None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.158158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.158881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.159059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.159329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.161130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.172902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1014/2009] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:02 2022] DELETE /identity/v3/users/c0c517b3f34d440ca41ce746c175319f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:03.172902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.173553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.175128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.177935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.196602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 996/2010] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:03.343856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e39f-004f-493e-b2ba-2bdf7103fad5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.348043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ada31-fcfe-40fb-a4d9-6bab0735c40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.349764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ada31-fcfe-40fb-a4d9-6bab0735c40c service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.349764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ada31-fcfe-40fb-a4d9-6bab0735c40c service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.349905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ada31-fcfe-40fb-a4d9-6bab0735c40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.385844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:03.456136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ada31-fcfe-40fb-a4d9-6bab0735c40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.457869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ada31-fcfe-40fb-a4d9-6bab0735c40c service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.471273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1015/2011] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:03.515017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.518031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.541582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437a80a-df00-438c-92d1-ea65d5c27dcd service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.546323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.547042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.547381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.547652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] PATH_INFO: `/v3/projects/e0d1f62fb0de450dbb41c236980a16d9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.549016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d1f62fb0de450dbb41c236980a16d9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.551084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.618160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d1f62fb0de450dbb41c236980a16d9', 'request_id': 'req-98772cb0-14b5-41bf-9c1c-a575307658c3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.637583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d1f62fb0de450dbb41c236980a16d9', 'request_id': 'req-98772cb0-14b5-41bf-9c1c-a575307658c3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.650544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d1f62fb0de450dbb41c236980a16d9', 'request_id': 'req-98772cb0-14b5-41bf-9c1c-a575307658c3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.664997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] The token cache is being invalidate because project e0d1f62fb0de450dbb41c236980a16d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:03.665291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.666004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.667527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 997/2012] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:03 2022] DELETE /identity/v3/projects/e0d1f62fb0de450dbb41c236980a16d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:03.673730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4236f-8595-477c-bc2e-9a051ca5f3ba None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.673934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4236f-8595-477c-bc2e-9a051ca5f3ba None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.674202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4236f-8595-477c-bc2e-9a051ca5f3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.703675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fca4236f-8595-477c-bc2e-9a051ca5f3ba None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:03.705024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fca4236f-8595-477c-bc2e-9a051ca5f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.748025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.749878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.782228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1016/2013] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:03.793058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.794511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.795072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.823841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:03.825075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.829210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772cb0-14b5-41bf-9c1c-a575307658c3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.835656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.836534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.836995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.837136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1017/2014] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:03.837476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.839867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.841120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.853209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc396a6-78ca-4518-a393-52d7142d0ae7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.867494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.868219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.868558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.868881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.869536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:03.869837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.871461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.884923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1018/2015] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:24:03.885822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.887522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:03.902123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55253e-3afd-47b0-b416-a98bc7335bf4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.907004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:03.907624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:03.907896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:03.908163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] PATH_INFO: `/v3/projects/4968742e63b8445abc6dd2fdaeef65f7` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:03.909663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4968742e63b8445abc6dd2fdaeef65f7)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.910313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:03.912216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.935831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:03.940241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:03.951888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 998/2016] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:03.953039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:03.962469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4968742e63b8445abc6dd2fdaeef65f7', 'request_id': 'req-772793e8-366c-4843-abbc-f2d101826b15'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.963776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0f47-ffdb-40da-81ec-01b04446e1c2 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:03.969310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4968742e63b8445abc6dd2fdaeef65f7', 'request_id': 'req-772793e8-366c-4843-abbc-f2d101826b15'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.977487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4968742e63b8445abc6dd2fdaeef65f7', 'request_id': 'req-772793e8-366c-4843-abbc-f2d101826b15'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.993241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] The token cache is being invalidate because project 4968742e63b8445abc6dd2fdaeef65f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:03.993241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.993826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-772793e8-366c-4843-abbc-f2d101826b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:03.995439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1019/2017] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:03 2022] DELETE /identity/v3/projects/4968742e63b8445abc6dd2fdaeef65f7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:04.000719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb08a7-6424-4f40-9fdc-cbb81f5646cd None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.001103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb08a7-6424-4f40-9fdc-cbb81f5646cd None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.001295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb08a7-6424-4f40-9fdc-cbb81f5646cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.029157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-90bb08a7-6424-4f40-9fdc-cbb81f5646cd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:04.030400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-90bb08a7-6424-4f40-9fdc-cbb81f5646cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:04.032803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.033426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.033702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.033984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.034591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.037185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.038996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1020/2018] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:04.046679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.046962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.047240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.070511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:04.074912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 999/2019] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:03 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:04.075253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:04.076583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.078474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:04.089435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:04.140937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1021/2020] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:04.145245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.152959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ff1b-faee-49dd-a913-3c5d4141f015 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.158581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.159307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.159616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.159885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.160513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.161903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e342e-7aaa-4292-90c0-12ae6f7a2eda None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.163323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.167418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.168238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.168561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.168980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.169863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:04.170253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.172064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.185747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1000/2021] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:04.186857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1022/2022] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:24:04.191003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.191160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.200819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4d89-1430-4cd3-b1ea-77c74ea3607c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.201003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b96c-1a2d-4abc-9780-f7b23fb43333 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.205728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.205939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.206321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.206512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.206611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.206787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.206885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.207054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.207498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.207682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.209769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.210164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.220519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1001/2023] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:04.225165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.235246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae8f7-5937-401e-ad82-e8fe63d9be6f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.239817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.240601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.240720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1023/2024] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:04.240854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.240987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.241628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.243242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.244514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.254818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1002/2025] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:04.260197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.273403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02d978-db46-4651-bee0-423400275f67 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.302247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:04.326605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bb385-e5a9-48bc-82ee-3f5f2be72835 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.335315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.336454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.336994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.337550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.338525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.339294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93387e5-4d90-446f-b8c9-40d39c783988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.339945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93387e5-4d90-446f-b8c9-40d39c783988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.340245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93387e5-4d90-446f-b8c9-40d39c783988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.340513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93387e5-4d90-446f-b8c9-40d39c783988 admin admin] PATH_INFO: `/v3/projects/ffcb91d44abf4587972078f065416bf9/users/b382e1d00e594b5484aa63c75069560d/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.342452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.371527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93387e5-4d90-446f-b8c9-40d39c783988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcb91d44abf4587972078f065416bf9, user_id=b382e1d00e594b5484aa63c75069560d, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.373276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1024/2026] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:04.374166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.375337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93387e5-4d90-446f-b8c9-40d39c783988 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.386859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44112-7cd1-4ea2-b0ab-0eb98d288d8f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.393301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1003/2027] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:04 2022] PUT /identity/v3/projects/ffcb91d44abf4587972078f065416bf9/users/b382e1d00e594b5484aa63c75069560d/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:04.404033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.404814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.405096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.440352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] MFA Rules not processed for user `b382e1d00e594b5484aa63c75069560d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:04.441641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:04.449250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.449856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.450128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.450392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.451035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.452635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.463504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1025/2028] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:04.467330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.478224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a5b07-f5b3-4078-830e-2c1799f408ba admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.483796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.484451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.484818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.485173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.486419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.487397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.494419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:04.498850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1026/2029] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:04.503165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.519377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef4677-b332-486d-95ba-c0552caba9f5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.524819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1004/2030] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:04.527314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.529786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779516e-ff29-46cf-b845-944ea53813bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.530456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779516e-ff29-46cf-b845-944ea53813bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.530728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779516e-ff29-46cf-b845-944ea53813bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.530994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779516e-ff29-46cf-b845-944ea53813bc admin admin] PATH_INFO: `/v3/projects/5b9a29be87f14219874738b35af86fcd/users/89c8aa2aa1644aa2bb872531b87e0e1c/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.541822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bda717-d0b0-4e57-b28a-03ca44934801 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.548455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.548929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779516e-ff29-46cf-b845-944ea53813bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9a29be87f14219874738b35af86fcd, user_id=89c8aa2aa1644aa2bb872531b87e0e1c, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.549161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.549441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.549717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.550360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.552918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.553258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779516e-ff29-46cf-b845-944ea53813bc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.573529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1027/2031] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:04 2022] PUT /identity/v3/projects/5b9a29be87f14219874738b35af86fcd/users/89c8aa2aa1644aa2bb872531b87e0e1c/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:04.588597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.589022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.589371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.604442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1005/2032] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:04.605804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.623714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] MFA Rules not processed for user `89c8aa2aa1644aa2bb872531b87e0e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:04.625112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:04.679333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603ef1e-fbe3-41e4-8956-48eb6a085a25 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.684829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.685828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.686111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.686382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.687006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.688962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.703148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1028/2033] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:04.711511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1006/2034] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:04.714136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.715268 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.715717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:04.726087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d86a9-8a72-4b1b-934a-a879833d64b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.731422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.732034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.732308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.732571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.733437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.735155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.737915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:04.749445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1007/2035] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:04.753396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.763294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a65c5-1993-4ca5-a622-03ce1054fb98 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.767866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.768504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.768805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.769071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] PATH_INFO: `/v3/projects/dba6022eb8fc46059c5fc94e59f7ee5a/users/2af9cfd60ce84216a845f52ac9789ee3/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.779783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642115a-3741-4d2c-be35-7a0e2909c908 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.783839 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.784296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba6022eb8fc46059c5fc94e59f7ee5a, user_id=2af9cfd60ce84216a845f52ac9789ee3, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.784416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.784694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.784987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.788089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.797717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.799439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.805229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1008/2036] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:04 2022] PUT /identity/v3/projects/dba6022eb8fc46059c5fc94e59f7ee5a/users/2af9cfd60ce84216a845f52ac9789ee3/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:04.808948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.810818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1029/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:04.876402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29f8ed-f7eb-4f03-b12c-2f148210d020 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.881322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1310a-9828-48e3-b7bb-9bc3bb8e99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.881923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1310a-9828-48e3-b7bb-9bc3bb8e99f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.882198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1310a-9828-48e3-b7bb-9bc3bb8e99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.882464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1310a-9828-48e3-b7bb-9bc3bb8e99f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.883094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1310a-9828-48e3-b7bb-9bc3bb8e99f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.884660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1310a-9828-48e3-b7bb-9bc3bb8e99f9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.898416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1009/2038] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:04.899990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:04.913458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75655757-545d-431a-ae26-49117fdace5e service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:04.918927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:04.919652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.920000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.920354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] PATH_INFO: `/v3/projects/dba6022eb8fc46059c5fc94e59f7ee5a/users/2af9cfd60ce84216a845f52ac9789ee3/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.922461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba6022eb8fc46059c5fc94e59f7ee5a, user_id=2af9cfd60ce84216a845f52ac9789ee3, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:04.925204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:04.938063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1030/2039] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:04 2022] PUT /identity/v3/projects/dba6022eb8fc46059c5fc94e59f7ee5a/users/2af9cfd60ce84216a845f52ac9789ee3/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:04.950381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:04.950836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:04.951195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:04.985712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] MFA Rules not processed for user `2af9cfd60ce84216a845f52ac9789ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:04.986918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:05.060075 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1010/2040] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:05.079494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:05.081440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:05.159227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aafb9-bcb9-4814-a25c-92caaeba59da admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:05.163752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d9ed-14d8-4b15-b6c7-1dda82bb07db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:05.164431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d9ed-14d8-4b15-b6c7-1dda82bb07db service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:05.164924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d9ed-14d8-4b15-b6c7-1dda82bb07db service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:05.165198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d9ed-14d8-4b15-b6c7-1dda82bb07db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:05.177781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d9ed-14d8-4b15-b6c7-1dda82bb07db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:05.179388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d9ed-14d8-4b15-b6c7-1dda82bb07db service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:05.183650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:05.192367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1031/2041] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:05.370250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:05.455315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:05.463921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1d68-b5f5-4197-a75d-ec39637a5e6e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:05.471132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:05.472152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:05.472499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:05.472891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] PATH_INFO: `/v3/users/b382e1d00e594b5484aa63c75069560d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:05.475301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b382e1d00e594b5484aa63c75069560d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:05.477712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:05.528064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b382e1d00e594b5484aa63c75069560d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:05.537391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b382e1d00e594b5484aa63c75069560d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:05.538540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b382e1d00e594b5484aa63c75069560d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:05.539377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b382e1d00e594b5484aa63c75069560d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:05.548651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b382e1d00e594b5484aa63c75069560d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:05.565999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1011/2042] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:05 2022] DELETE /identity/v3/users/b382e1d00e594b5484aa63c75069560d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:05.570441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:05.570714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:05.570987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:05.590464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:05.591654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:05.650134 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1032/2043] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:05.659867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:05.662114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:05.726535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958b43-1508-418a-9e3c-f14a438abcaf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:05.730565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:05.731176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:05.731473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:05.731740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:05.741828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:05.743550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:05.753506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1012/2044] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:06.041436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:06.042932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:06.055416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3a7e-25c4-4fc7-ab4e-5eadecc00f90 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:06.059986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:06.060616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:06.060920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:06.061189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] PATH_INFO: `/v3/projects/ffcb91d44abf4587972078f065416bf9` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:06.062309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcb91d44abf4587972078f065416bf9)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:06.064221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:06.113410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcb91d44abf4587972078f065416bf9', 'request_id': 'req-97adb035-bb11-4871-857e-c2e2f699f6ed'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.120444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcb91d44abf4587972078f065416bf9', 'request_id': 'req-97adb035-bb11-4871-857e-c2e2f699f6ed'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.125937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcb91d44abf4587972078f065416bf9', 'request_id': 'req-97adb035-bb11-4871-857e-c2e2f699f6ed'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.138291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] The token cache is being invalidate because project ffcb91d44abf4587972078f065416bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:06.138572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.139179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-97adb035-bb11-4871-857e-c2e2f699f6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.140667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1033/2045] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:06 2022] DELETE /identity/v3/projects/ffcb91d44abf4587972078f065416bf9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:06.144700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:06.155130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fee6e-6eda-48eb-a12a-63e995bf6ad3 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:06.206340 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:06.206636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:06.206907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:06.216698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:06.217385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:06.217662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:06.217932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] PATH_INFO: `/v3/users/2af9cfd60ce84216a845f52ac9789ee3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:06.219043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af9cfd60ce84216a845f52ac9789ee3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:06.220986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:06.226696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] MFA Rules not processed for user `89c8aa2aa1644aa2bb872531b87e0e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:06.228094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:06.248704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:06.275035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af9cfd60ce84216a845f52ac9789ee3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.282023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af9cfd60ce84216a845f52ac9789ee3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.282937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af9cfd60ce84216a845f52ac9789ee3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.283610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af9cfd60ce84216a845f52ac9789ee3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.285870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1034/2046] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:06.293851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c56a3af8-09eb-485c-aa05-3a70e7bf8330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af9cfd60ce84216a845f52ac9789ee3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.313416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1013/2047] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:06 2022] DELETE /identity/v3/users/2af9cfd60ce84216a845f52ac9789ee3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:06.649902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:06.651546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:06.675878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838280d1-225c-4deb-ad80-05e868afed0e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:06.716954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:06.762978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:06.763728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:06.764001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:06.764271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] PATH_INFO: `/v3/projects/dba6022eb8fc46059c5fc94e59f7ee5a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:06.765568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba6022eb8fc46059c5fc94e59f7ee5a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:06.767648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:06.830758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba6022eb8fc46059c5fc94e59f7ee5a', 'request_id': 'req-2080d102-b2c6-43b3-95f5-8ea23ec73705'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.838243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba6022eb8fc46059c5fc94e59f7ee5a', 'request_id': 'req-2080d102-b2c6-43b3-95f5-8ea23ec73705'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.845058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba6022eb8fc46059c5fc94e59f7ee5a', 'request_id': 'req-2080d102-b2c6-43b3-95f5-8ea23ec73705'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.862662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] The token cache is being invalidate because project dba6022eb8fc46059c5fc94e59f7ee5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:06.863946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.866107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2080d102-b2c6-43b3-95f5-8ea23ec73705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:06.873473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1035/2048] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:06 2022] DELETE /identity/v3/projects/dba6022eb8fc46059c5fc94e59f7ee5a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:06.875081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:06.875469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:06.875772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:06.910784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:06.912394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:07.004853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1014/2049] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:07.011823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.012436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.012968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.042136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:07.043847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:07.054397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1036/2050] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:07.058800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.070736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96618d-8b8e-4878-b0bb-8c1a00db239b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.075634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.076241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.076516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.076813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.077509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:07.078140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.079875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.093329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1015/2051] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:24:07.098086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.108544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73d0da-5409-41f7-81a9-bc5d037dfdff None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.113723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.115149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.115635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.116115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.116953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.119011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.157104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1037/2052] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:07 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:07.158257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.169371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc449-0fce-417d-9d67-79bebf1022e3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.251557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.252240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.252583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.253628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.254363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.258718 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.287114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1016/2053] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:07 2022] POST /identity/v3/users => generated 279 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:07.288248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.298568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc30a-ce3a-496f-8a63-a77cb9834032 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.303819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.304402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.304694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.305054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.305693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.307267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.317939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1038/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:07.322332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.333549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c436453-429b-4c9d-b437-ca4a6ac8e3b6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.339147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d49ff-df23-46ac-9f77-10b990f8c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.339839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d49ff-df23-46ac-9f77-10b990f8c112 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.340285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d49ff-df23-46ac-9f77-10b990f8c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.340743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d49ff-df23-46ac-9f77-10b990f8c112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.341428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d49ff-df23-46ac-9f77-10b990f8c112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.343057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d49ff-df23-46ac-9f77-10b990f8c112 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.358522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1017/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:07.362849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.374792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d8d3-2dcd-43b0-b1cc-c90192b7050c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.380826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.381534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.381810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.382085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] PATH_INFO: `/v3/projects/05e9e44eb9784275937283f3fee62537/users/bf9045491df540bba3e4651597b34fdf/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.399750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e9e44eb9784275937283f3fee62537, user_id=bf9045491df540bba3e4651597b34fdf, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.402603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.419929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1039/2056] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:07 2022] PUT /identity/v3/projects/05e9e44eb9784275937283f3fee62537/users/bf9045491df540bba3e4651597b34fdf/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:07.431010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.431296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.431570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.438858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:07.464124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] MFA Rules not processed for user `bf9045491df540bba3e4651597b34fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:07.465380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:07.544748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1018/2057] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:07.549015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.614398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:07.627198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deebee0-693c-4972-b7b9-9aa66dc66531 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.633025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.633636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.633913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.634181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.634822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.636747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.668725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1040/2058] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:07 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:07.670303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.682853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0142cd-c86f-4fb2-9dad-504af7136a2c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.744121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.744737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.745044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.745310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.745933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.747949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.773713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1019/2059] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:07 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:07.777664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.788019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed98c1-ad7d-4d89-be6c-fc3ecd9ef422 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.792687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.798497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.798497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.798497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.798497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.798497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.808788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1041/2060] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:07.812924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.824032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281058d-a376-4191-8fd8-0d6041a4e163 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.828929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.829560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.829821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.830627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] PATH_INFO: `/v3/projects/35d7b72d21c54738805252b04a196a44/users/e37023d2508044cda9f574343fcab68b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.845956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d7b72d21c54738805252b04a196a44, user_id=e37023d2508044cda9f574343fcab68b, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.848632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.865690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1020/2061] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:07 2022] PUT /identity/v3/projects/35d7b72d21c54738805252b04a196a44/users/e37023d2508044cda9f574343fcab68b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:07.869641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.879647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d1dde-2a00-4f5e-a3c3-340282fc193f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.941993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71607cb6-c039-4806-9ff2-ee3aa76098c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.942777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71607cb6-c039-4806-9ff2-ee3aa76098c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.943087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71607cb6-c039-4806-9ff2-ee3aa76098c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.943470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71607cb6-c039-4806-9ff2-ee3aa76098c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.944145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71607cb6-c039-4806-9ff2-ee3aa76098c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.945842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71607cb6-c039-4806-9ff2-ee3aa76098c6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.961265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1042/2062] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:07.962384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:07.972411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8770d76-32fa-4ad3-b596-e3997a2eec01 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:07.977997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:07.978643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:07.978917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:07.979186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] PATH_INFO: `/v3/projects/35d7b72d21c54738805252b04a196a44/users/e37023d2508044cda9f574343fcab68b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:07.981086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d7b72d21c54738805252b04a196a44, user_id=e37023d2508044cda9f574343fcab68b, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:07.983683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:07.995225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1021/2063] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:07 2022] PUT /identity/v3/projects/35d7b72d21c54738805252b04a196a44/users/e37023d2508044cda9f574343fcab68b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:08.007296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55804f6-e730-4bc5-9686-46081272948d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.007580 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55804f6-e730-4bc5-9686-46081272948d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.007854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55804f6-e730-4bc5-9686-46081272948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.038758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d55804f6-e730-4bc5-9686-46081272948d None None] MFA Rules not processed for user `e37023d2508044cda9f574343fcab68b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:08.040060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d55804f6-e730-4bc5-9686-46081272948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.124971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:08.128009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.134099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1043/2064] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:08.146513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55804f6-e730-4bc5-9686-46081272948d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:08.147902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d55804f6-e730-4bc5-9686-46081272948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.185535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:08.206246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23a4e-1ef9-448d-a5b4-fb0623c97a9d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:08.211491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:08.212118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.212630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.212759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:08.212937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] PATH_INFO: `/v3/users/a2fcaf6cdc6a480fb045dab5db6af18e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.214074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fcaf6cdc6a480fb045dab5db6af18e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:08.216399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:08.219925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55804f6-e730-4bc5-9686-46081272948d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:08.226076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf049c09-f819-4094-ba6f-16a283fb4d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:08.227108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049c09-f819-4094-ba6f-16a283fb4d91 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.227729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049c09-f819-4094-ba6f-16a283fb4d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.228391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049c09-f819-4094-ba6f-16a283fb4d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.240742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf049c09-f819-4094-ba6f-16a283fb4d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:08.242355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf049c09-f819-4094-ba6f-16a283fb4d91 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:08.259620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1044/2065] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:08.298742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fcaf6cdc6a480fb045dab5db6af18e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.307499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fcaf6cdc6a480fb045dab5db6af18e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.308423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fcaf6cdc6a480fb045dab5db6af18e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.309154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fcaf6cdc6a480fb045dab5db6af18e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.318813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fcaf6cdc6a480fb045dab5db6af18e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.342583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1022/2066] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:08 2022] DELETE /identity/v3/users/a2fcaf6cdc6a480fb045dab5db6af18e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:08.351258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.351781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.352147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.367304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:08.368725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.373110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:08.374331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.426422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc025f8-8f6b-43e6-9d5b-c62b9feb9667 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:08.435557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:08.436280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.436642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.436999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.438940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.441285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1045/2067] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:08.450989 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:08.452322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.501579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:08.503100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:08.511720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23c1a2-a965-4f55-b37c-b9445f3c096d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:08.513234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1023/2068] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:08.515882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:08.516491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.516766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.517089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.528433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:08.529980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:08.542756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1046/2069] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:08.894428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:08.899948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:08.917325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8df03-e01f-47b9-b0b8-1fcd7e8308d8 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:08.924458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:08.925022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:08.925304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:08.925612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] PATH_INFO: `/v3/projects/6b38019e05f4424ea00db7cf029555d9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:08.926872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b38019e05f4424ea00db7cf029555d9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:08.929171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:08.940827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:08.979721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b38019e05f4424ea00db7cf029555d9', 'request_id': 'req-0c3d4d72-452a-4b63-8805-15b3545f60c6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.987823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b38019e05f4424ea00db7cf029555d9', 'request_id': 'req-0c3d4d72-452a-4b63-8805-15b3545f60c6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:08.994580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b38019e05f4424ea00db7cf029555d9', 'request_id': 'req-0c3d4d72-452a-4b63-8805-15b3545f60c6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.006067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] The token cache is being invalidate because project 6b38019e05f4424ea00db7cf029555d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:09.006360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.007014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.008531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1024/2070] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:08 2022] DELETE /identity/v3/projects/6b38019e05f4424ea00db7cf029555d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:09.012517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:09.022798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe044e-7111-4908-be4a-63363a92e9d3 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:09.085700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:09.086327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:09.086598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:09.086868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] PATH_INFO: `/v3/users/70fa97af65df4f2391928296ca615bd9` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:09.088028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fa97af65df4f2391928296ca615bd9)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:09.089936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:09.131661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:09.142226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fa97af65df4f2391928296ca615bd9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.142984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fa97af65df4f2391928296ca615bd9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.143520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fa97af65df4f2391928296ca615bd9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.153267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fa97af65df4f2391928296ca615bd9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.162497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fa97af65df4f2391928296ca615bd9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.181985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1047/2071] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:09 2022] DELETE /identity/v3/users/70fa97af65df4f2391928296ca615bd9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:09.532022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:09.533320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:09.550134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d4d72-452a-4b63-8805-15b3545f60c6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:09.617325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:09.618269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:09.618494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:09.618761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] PATH_INFO: `/v3/projects/46fe8aeed073427a93522c8ec1375938` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:09.619900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fe8aeed073427a93522c8ec1375938)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:09.622119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:09.678708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fe8aeed073427a93522c8ec1375938', 'request_id': 'req-dff244ee-10bf-414d-ae5e-50fa964ea287'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.686385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fe8aeed073427a93522c8ec1375938', 'request_id': 'req-dff244ee-10bf-414d-ae5e-50fa964ea287'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.693491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fe8aeed073427a93522c8ec1375938', 'request_id': 'req-dff244ee-10bf-414d-ae5e-50fa964ea287'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.704630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] The token cache is being invalidate because project 46fe8aeed073427a93522c8ec1375938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:09.705015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.705731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.707650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1025/2072] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:09 2022] DELETE /identity/v3/projects/46fe8aeed073427a93522c8ec1375938 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:09.711986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:09.713412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:09.735932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01427f8e-efb7-4431-afba-b72bb404b63c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:09.868507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:09.872893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:09.874246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:09.875356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] PATH_INFO: `/v3/users/0dd62141886c4ea2a28fab64d393e502` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:09.879224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd62141886c4ea2a28fab64d393e502)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:09.881856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:09.966216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd62141886c4ea2a28fab64d393e502'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.969632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd62141886c4ea2a28fab64d393e502'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.970513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd62141886c4ea2a28fab64d393e502'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:09.987040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd62141886c4ea2a28fab64d393e502'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.000831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8bf10009-8a82-43b0-a120-81fa950ea054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd62141886c4ea2a28fab64d393e502'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.026192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1048/2073] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:09 2022] DELETE /identity/v3/users/0dd62141886c4ea2a28fab64d393e502 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:10.479186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:10.480679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:10.508999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff244ee-10bf-414d-ae5e-50fa964ea287 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:10.557852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:10.591674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:10.592687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:10.593208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:10.593711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] PATH_INFO: `/v3/projects/f240067e649349c88635624398775f0e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:10.595174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f240067e649349c88635624398775f0e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:10.597457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:10.677804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f240067e649349c88635624398775f0e', 'request_id': 'req-4ad06b2b-8094-45df-931a-287db3219506'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.687889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f240067e649349c88635624398775f0e', 'request_id': 'req-4ad06b2b-8094-45df-931a-287db3219506'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.699286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f240067e649349c88635624398775f0e', 'request_id': 'req-4ad06b2b-8094-45df-931a-287db3219506'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.715516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] The token cache is being invalidate because project f240067e649349c88635624398775f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:10.715812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.716734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4ad06b2b-8094-45df-931a-287db3219506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:10.719496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1026/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:10 2022] DELETE /identity/v3/projects/f240067e649349c88635624398775f0e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:10.726475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:10.727531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:10.728111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:10.756211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:10.757847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:10.813815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:10.854568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1049/2075] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:10.862598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:10.862953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:10.863301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:10.892190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:10.894278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:10.917866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:10.923020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1027/2076] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:10.931154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d6e2b-607d-4082-a032-60999f5c4612 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:10.940335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:10.941086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:10.941367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:10.941636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:10.942426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:10.942691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:10.944500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:10.958593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1050/2077] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:24:10.962946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:10.972857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3aad1-ece6-4ec0-a96e-23ef80a4292d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:10.984279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:10.985055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:10.985484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:10.985826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:10.986855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:10.988961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:11.024532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1028/2078] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:10 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:11.025485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:11.046752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d6a4e-0682-43d9-adee-bcbd60451cfe admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:11.112992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:11.113719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:11.114883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:11.114883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:11.115080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:11.116897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:11.146523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1051/2079] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:11 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:11.150399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:11.163648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa94213-b4d1-4d59-a87a-5a3405444f6a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:11.168941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:11.169845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:11.170299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:11.170742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:11.171558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:11.173376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:11.186812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1029/2080] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:11.191009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:11.201297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a66e16-be2f-4632-9365-ae5b3e1ad43f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:11.206588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e31d2-afc0-40be-a7fb-e5f89ac5ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:11.207295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e31d2-afc0-40be-a7fb-e5f89ac5ee2e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:11.207472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e31d2-afc0-40be-a7fb-e5f89ac5ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:11.207801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e31d2-afc0-40be-a7fb-e5f89ac5ee2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:11.208454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e31d2-afc0-40be-a7fb-e5f89ac5ee2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:11.210145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e31d2-afc0-40be-a7fb-e5f89ac5ee2e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:11.222348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1052/2081] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:11.226981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:11.238305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b966d4f-69dd-4687-88fe-707956be3f5d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:11.244543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:11.245255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:11.245535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:11.245807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] PATH_INFO: `/v3/projects/b248cec406c24aee8df4f63a24a5a6ba/users/51bb880d57474b658f1cf85353c00743/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:11.263858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b248cec406c24aee8df4f63a24a5a6ba, user_id=51bb880d57474b658f1cf85353c00743, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:11.267095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:11.282415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1030/2082] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:11 2022] PUT /identity/v3/projects/b248cec406c24aee8df4f63a24a5a6ba/users/51bb880d57474b658f1cf85353c00743/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:11.288699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e8a91-685f-415c-a0c3-3c50274a8c22 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:11.289000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e8a91-685f-415c-a0c3-3c50274a8c22 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:11.289280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e8a91-685f-415c-a0c3-3c50274a8c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:11.310359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-159e8a91-685f-415c-a0c3-3c50274a8c22 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:11.311599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-159e8a91-685f-415c-a0c3-3c50274a8c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:11.389129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1053/2083] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:11.408133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:11.409993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:11.500757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a14e-2c49-4b3b-8607-49b7dcad20f9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:11.506832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:11.507467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:11.507741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:11.508005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:11.523456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:11.524939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:11.530001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:11.536442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1031/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:12.340987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6547f-ca55-4316-ba58-5004f8b21043 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:12.341539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6547f-ca55-4316-ba58-5004f8b21043 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:12.341539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6547f-ca55-4316-ba58-5004f8b21043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:12.374105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e8a6547f-ca55-4316-ba58-5004f8b21043 None None] MFA Rules not processed for user `51bb880d57474b658f1cf85353c00743`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:12.375328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e8a6547f-ca55-4316-ba58-5004f8b21043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:12.406860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:12.445732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1054/2085] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:12.457361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:12.459486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:12.520894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4d15-2ece-45b6-9930-ddcfe81a1f7f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:12.524690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:12.526557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:12.526557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:12.526557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:12.536702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:12.538584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:12.549271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1032/2086] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:13.983872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd129-a8bd-4696-a794-db2bfb6382c5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:13.984440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd129-a8bd-4696-a794-db2bfb6382c5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:13.984440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd129-a8bd-4696-a794-db2bfb6382c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:14.005215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ae2fd129-a8bd-4696-a794-db2bfb6382c5 None None] MFA Rules not processed for user `51bb880d57474b658f1cf85353c00743`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:14.006664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ae2fd129-a8bd-4696-a794-db2bfb6382c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:14.018224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1055/2087] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:22.544457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=26 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:23.999006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=17 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:24.335584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:24.337070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:24.353588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc90bf-d5aa-455d-bcc9-6841e0bf8591 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:24.365092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:24.365786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:24.366795 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:24.367221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] PATH_INFO: `/v3/users/bf9045491df540bba3e4651597b34fdf` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:24.368311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b3d3-daac-4cdd-9ce7-a2c77f966390 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:24.368553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9045491df540bba3e4651597b34fdf)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:24.368662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b3d3-daac-4cdd-9ce7-a2c77f966390 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:24.368880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b3d3-daac-4cdd-9ce7-a2c77f966390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:24.370500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:24.398936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5599b3d3-daac-4cdd-9ce7-a2c77f966390 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:24.401539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5599b3d3-daac-4cdd-9ce7-a2c77f966390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:24.432031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9045491df540bba3e4651597b34fdf'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:24.440373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9045491df540bba3e4651597b34fdf'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:24.441295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9045491df540bba3e4651597b34fdf'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:24.443284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9045491df540bba3e4651597b34fdf'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:24.455681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9045491df540bba3e4651597b34fdf'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:24.473933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1056/2088] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:24.479722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1033/2089] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:24 2022] DELETE /identity/v3/users/bf9045491df540bba3e4651597b34fdf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:24.484200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:24.484448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:24.484719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:24.506862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:24.508076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:24.529847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:24.531567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:24.591471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1057/2090] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:24.602237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:24.604199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:24.618195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471f01c-afdb-4f68-863e-a8ae87ee56c3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:24.624182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:24.624907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:24.625180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:24.625446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:24.666886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2d9a-845c-4285-8bba-da66dd03f6a6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:24.670562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:24.671529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:24.671529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:24.671739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:24.683880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:24.685360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:24.696292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1058/2091] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:24.699606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:24.701221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:24.712562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1034/2092] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:24:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:24:25.016204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:25.018207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:25.037881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c166ea-c8cd-46aa-ad0c-e26242549f99 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:25.043485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:25.044122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.044479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.044853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] PATH_INFO: `/v3/projects/05e9e44eb9784275937283f3fee62537` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.046005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e9e44eb9784275937283f3fee62537)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:25.047890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:25.110611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:25.116217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e9e44eb9784275937283f3fee62537', 'request_id': 'req-fecc1a58-a998-411d-82fa-a2b0fe9c2141'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.128071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e9e44eb9784275937283f3fee62537', 'request_id': 'req-fecc1a58-a998-411d-82fa-a2b0fe9c2141'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.135017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e9e44eb9784275937283f3fee62537', 'request_id': 'req-fecc1a58-a998-411d-82fa-a2b0fe9c2141'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.148050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] The token cache is being invalidate because project 05e9e44eb9784275937283f3fee62537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:25.148344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.149103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fecc1a58-a998-411d-82fa-a2b0fe9c2141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.150584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1059/2093] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:25 2022] DELETE /identity/v3/projects/05e9e44eb9784275937283f3fee62537 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:25.154984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:25.166127 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94352-73fa-47e9-8df1-fa329b3b3828 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:25.175410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:25.229067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:25.229697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.229991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.230259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] PATH_INFO: `/v3/users/e37023d2508044cda9f574343fcab68b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.231461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37023d2508044cda9f574343fcab68b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:25.233426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:25.281642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37023d2508044cda9f574343fcab68b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.292997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37023d2508044cda9f574343fcab68b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.294002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37023d2508044cda9f574343fcab68b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.294636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37023d2508044cda9f574343fcab68b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.305983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37023d2508044cda9f574343fcab68b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.327396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1035/2094] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:25 2022] DELETE /identity/v3/users/e37023d2508044cda9f574343fcab68b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:25.334794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148814c-856d-449c-a15d-726462725ce9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.335147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148814c-856d-449c-a15d-726462725ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.335428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148814c-856d-449c-a15d-726462725ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.355741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7148814c-856d-449c-a15d-726462725ce9 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:25.358184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7148814c-856d-449c-a15d-726462725ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:25.448145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1060/2095] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 28 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:25.466129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:25.468286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:25.562169 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be7421-6829-41d7-a196-bcfa4f7b4571 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:25.568836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7931cb-3de0-4117-b2d5-d19f064e5fa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:25.570618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7931cb-3de0-4117-b2d5-d19f064e5fa7 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.571522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7931cb-3de0-4117-b2d5-d19f064e5fa7 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.572372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7931cb-3de0-4117-b2d5-d19f064e5fa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.584699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7931cb-3de0-4117-b2d5-d19f064e5fa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:25.586333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7931cb-3de0-4117-b2d5-d19f064e5fa7 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:25.598687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1036/2096] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:24:25.684700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148814c-856d-449c-a15d-726462725ce9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:25.686458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7148814c-856d-449c-a15d-726462725ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:25.776151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148814c-856d-449c-a15d-726462725ce9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:25.785207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:25.786501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.786851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.788497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] PATH_INFO: `/v3/projects/35d7b72d21c54738805252b04a196a44` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.789770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d7b72d21c54738805252b04a196a44)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:25.791799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:25.845023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d7b72d21c54738805252b04a196a44', 'request_id': 'req-cbab9fd0-d322-47c5-a869-c40da28e9b17'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.852004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d7b72d21c54738805252b04a196a44', 'request_id': 'req-cbab9fd0-d322-47c5-a869-c40da28e9b17'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.858092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d7b72d21c54738805252b04a196a44', 'request_id': 'req-cbab9fd0-d322-47c5-a869-c40da28e9b17'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.873563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] The token cache is being invalidate because project 35d7b72d21c54738805252b04a196a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:25.874043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.874741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cbab9fd0-d322-47c5-a869-c40da28e9b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:25.876931 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1061/2097] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:25 2022] DELETE /identity/v3/projects/35d7b72d21c54738805252b04a196a44 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:25.882498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925ff3-f09c-4a35-bfb8-c513e9948ee2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.882787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925ff3-f09c-4a35-bfb8-c513e9948ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.883058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925ff3-f09c-4a35-bfb8-c513e9948ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.904130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a8925ff3-f09c-4a35-bfb8-c513e9948ee2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:25.905720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8925ff3-f09c-4a35-bfb8-c513e9948ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:25.926747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:25.927289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:25.927566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:25.929179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:25.956829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:25.966242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:25.968657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:26.013221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1037/2098] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:26.022676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.022957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.024202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.044249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1062/2099] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:26.050426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:26.052863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:26.057080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.058591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:26.062558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1038/2100] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:26.066886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.077787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b344be7-4e9b-4544-96ef-6e0d6052f8f0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.084059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.084671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.084985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.085300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.085996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:26.086295 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.088347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.106045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1039/2101] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:24:26.110496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.124593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318a9be-cad1-43c7-ac6a-676c6fff76e2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.133288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.134233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.134376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.135010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.135855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.138389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.178812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1040/2102] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:26.179758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.183473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995ef00-bcf0-4959-83ce-9342570275d5 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.257698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb5d1-32a3-4066-9725-036ce1de4883 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.263671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.264346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.264656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.264964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.265583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.267572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.272566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.273234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.273510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.273775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.289487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1041/2103] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:26.293574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.304877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d09b-c94c-4881-9eaf-fa9a0a2541b6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.309622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.310242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.310469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.310729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.311418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.313014 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.324006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1042/2104] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:26.328256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.329501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:26.332678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.334735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.338380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f594008-5b82-48e5-ad78-5b7c7d4ab7d4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.343048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8ab96-6c72-4c1f-8f5e-d712f82205e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.343180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1063/2105] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:24:26.343628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8ab96-6c72-4c1f-8f5e-d712f82205e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.343909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8ab96-6c72-4c1f-8f5e-d712f82205e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.344177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8ab96-6c72-4c1f-8f5e-d712f82205e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.344833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8ab96-6c72-4c1f-8f5e-d712f82205e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.346398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8ab96-6c72-4c1f-8f5e-d712f82205e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.357776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1043/2106] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:26.362173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.373973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd427ac-9e31-45f5-bbf1-06e2b600bf3a service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.378669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.380063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.380346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.380615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] PATH_INFO: `/v3/projects/bfae937c94f648b9a1a3d6eaf9eed68e/users/c7bb109ef6994c558f4d8af2fcd8232e/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.397381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfae937c94f648b9a1a3d6eaf9eed68e, user_id=c7bb109ef6994c558f4d8af2fcd8232e, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.400061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.414705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1064/2107] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:26 2022] PUT /identity/v3/projects/bfae937c94f648b9a1a3d6eaf9eed68e/users/c7bb109ef6994c558f4d8af2fcd8232e/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:26.426916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.427203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.427474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.456439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] MFA Rules not processed for user `c7bb109ef6994c558f4d8af2fcd8232e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:26.457772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:26.498292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:26.529510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1044/2108] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:26.535213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.640110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95e52-d2b3-4eff-8026-e0e9fd10ca96 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.647318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b32d9-3635-4bf9-9406-cb33a839658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.648163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b32d9-3635-4bf9-9406-cb33a839658d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.648703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b32d9-3635-4bf9-9406-cb33a839658d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.649194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b32d9-3635-4bf9-9406-cb33a839658d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.649941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b32d9-3635-4bf9-9406-cb33a839658d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.651949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b32d9-3635-4bf9-9406-cb33a839658d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.715025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1065/2109] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:26.718868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.731199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c039-63c5-4a1a-8d30-e8b3b9a9f1cc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.741870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.742584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.742954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.772617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:26.774135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:26.798428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.799153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.799489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.799826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.800520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.811878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.851904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1045/2110] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:26.855932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.860938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1066/2111] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 28 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:26.874117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.879329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f04d1-8d10-4207-a12c-fe3232ca4d1f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.884394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.885577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.885577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.885793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.886381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.887967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.903649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1046/2112] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:26.904700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.916974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882862-ec4d-42fa-bfd3-c4fa243c4e19 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.921975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.922754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.923047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.923321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.923964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.925691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.940688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1047/2113] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:26.942363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:26.963148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169715f7-7c96-475d-9ba9-1d651ca08f1d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.965321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:26.969490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.970146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.970581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.970858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] PATH_INFO: `/v3/projects/02c14c9870d24ad5b8f692a50177e6e1/users/c73275c998c64426a2b818b051a066db/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.970978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae96128-9389-46ca-817f-fec116f2c494 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:26.978198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f8cc0-4ccf-4319-bb48-9835a42eda2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:26.978741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8cc0-4ccf-4319-bb48-9835a42eda2a service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:26.979020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8cc0-4ccf-4319-bb48-9835a42eda2a service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:26.979862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8cc0-4ccf-4319-bb48-9835a42eda2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:26.987289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c14c9870d24ad5b8f692a50177e6e1, user_id=c73275c998c64426a2b818b051a066db, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.990569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f8cc0-4ccf-4319-bb48-9835a42eda2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:26.990888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:26.992145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f8cc0-4ccf-4319-bb48-9835a42eda2a service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.002643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1067/2114] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:24:27.007296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1048/2115] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:26 2022] PUT /identity/v3/projects/02c14c9870d24ad5b8f692a50177e6e1/users/c73275c998c64426a2b818b051a066db/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:27.017669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.017976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.018229 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.051936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] MFA Rules not processed for user `c73275c998c64426a2b818b051a066db`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:27.056556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:27.137449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1068/2116] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:27.142106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.224533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0b15-e503-4bad-86f4-99b83d9b468c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.229879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.230493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.230746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.231011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.231641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.233537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.264220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1049/2117] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:27 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:27.268529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.283480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2517-3f7e-4b30-8b7c-99cb844ccbae None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.358632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.359342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.359525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.359800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.360374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.362381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.387112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1069/2118] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:27 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:27.388354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.399673 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17946-4588-43bc-bec8-28de77abc754 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.404796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.405502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.405851 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.406190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.406896 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.408548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.410711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:27.428337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1050/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:27.429818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.440716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15211400-0db1-4019-bb81-a707691050ac admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.445992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.446646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.446924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.447193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] PATH_INFO: `/v3/projects/8d96e36a09af41e9af7a4d3e2d340535/users/4d1b717fc9f141febfcb0587990e26ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.463620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d96e36a09af41e9af7a4d3e2d340535, user_id=4d1b717fc9f141febfcb0587990e26ab, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.466382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.480975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1070/2120] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:27 2022] PUT /identity/v3/projects/8d96e36a09af41e9af7a4d3e2d340535/users/4d1b717fc9f141febfcb0587990e26ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:27.485111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.495231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a0bb-30e1-486e-817b-2b8feae38843 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.554614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22fce-578d-409a-856b-54ed005fe42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.555251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22fce-578d-409a-856b-54ed005fe42f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.555486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22fce-578d-409a-856b-54ed005fe42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.555756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22fce-578d-409a-856b-54ed005fe42f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.556397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22fce-578d-409a-856b-54ed005fe42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.558017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22fce-578d-409a-856b-54ed005fe42f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.572477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1051/2121] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:27.573750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.585619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2def-a565-479d-84c9-b932ca311c4e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.590470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.591117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.591408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.591702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] PATH_INFO: `/v3/projects/8d96e36a09af41e9af7a4d3e2d340535/users/4d1b717fc9f141febfcb0587990e26ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.593715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d96e36a09af41e9af7a4d3e2d340535, user_id=4d1b717fc9f141febfcb0587990e26ab, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.596570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.608323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1071/2122] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:27 2022] PUT /identity/v3/projects/8d96e36a09af41e9af7a4d3e2d340535/users/4d1b717fc9f141febfcb0587990e26ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:27.622167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.622462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.622734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.652415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] MFA Rules not processed for user `4d1b717fc9f141febfcb0587990e26ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:27.653740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:27.745298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1052/2123] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:27.754569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.757781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:27.803168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:27.837568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17526222-dc13-4e2b-a1fc-9c0e8ef6baba admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.841703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.842310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.842590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.842860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:27.858155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:27.859814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:27.870913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1072/2124] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:27.923876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:27.936288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e2c52-1fc5-450c-8d2b-66092a60c5a5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:27.945001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b34bd-d601-4287-b849-3d6178d2b9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:27.945823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b34bd-d601-4287-b849-3d6178d2b9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:27.946195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b34bd-d601-4287-b849-3d6178d2b9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:27.946682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b34bd-d601-4287-b849-3d6178d2b9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:28.023560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b34bd-d601-4287-b849-3d6178d2b9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:28.026116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b34bd-d601-4287-b849-3d6178d2b9c9 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:28.047227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1053/2125] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:28.421442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:28.425152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:28.533025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4642f2-2bca-4f19-80b3-70fd5ed7388b service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:28.542931 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:28.543562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:28.543881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:28.544268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] PATH_INFO: `/v3/users/35c1b00ce07b4543bd9877ddf0186594` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:28.545887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c1b00ce07b4543bd9877ddf0186594)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:28.548496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:28.611934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c1b00ce07b4543bd9877ddf0186594'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:28.612591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c1b00ce07b4543bd9877ddf0186594'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:28.613298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c1b00ce07b4543bd9877ddf0186594'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:28.621111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c1b00ce07b4543bd9877ddf0186594'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:28.628625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c1b00ce07b4543bd9877ddf0186594'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:28.649486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1073/2126] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:28 2022] DELETE /identity/v3/users/35c1b00ce07b4543bd9877ddf0186594 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:28.653913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:28.654389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:28.654479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:28.674965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:28.676477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:28.686048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:28.742346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1054/2127] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:28.752196 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:28.753603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:28.812178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b8a9-50d5-4389-ae17-1ddba04ec962 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:28.815811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205c20-6a88-4d2a-b659-0d065873e34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:28.817005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205c20-6a88-4d2a-b659-0d065873e34b service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:28.817283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205c20-6a88-4d2a-b659-0d065873e34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:28.817553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205c20-6a88-4d2a-b659-0d065873e34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:28.826705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205c20-6a88-4d2a-b659-0d065873e34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:28.828405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205c20-6a88-4d2a-b659-0d065873e34b service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:28.832395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:28.839509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1074/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:29.121468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.122930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.136692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad0c5b-03ce-4811-a066-855be456aa2b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.141309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.141946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.142223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.142491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] PATH_INFO: `/v3/projects/4235e23e400e4384a0fc93adf8f8a40f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.144363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4235e23e400e4384a0fc93adf8f8a40f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.146465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.194535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4235e23e400e4384a0fc93adf8f8a40f', 'request_id': 'req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.201810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4235e23e400e4384a0fc93adf8f8a40f', 'request_id': 'req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.208445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4235e23e400e4384a0fc93adf8f8a40f', 'request_id': 'req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.218600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] The token cache is being invalidate because project 4235e23e400e4384a0fc93adf8f8a40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:29.218886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.219517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.221021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1055/2129] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:29 2022] DELETE /identity/v3/projects/4235e23e400e4384a0fc93adf8f8a40f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:29.227757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a402e0-8f81-456f-ae1d-56d73cb532a0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.228040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a402e0-8f81-456f-ae1d-56d73cb532a0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.228311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a402e0-8f81-456f-ae1d-56d73cb532a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.249925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-96a402e0-8f81-456f-ae1d-56d73cb532a0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:29.251149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-96a402e0-8f81-456f-ae1d-56d73cb532a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.258564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.260059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.325678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1075/2130] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:29.334146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.334456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.334693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.353347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42c3f6-e12d-4c5e-bc3b-9a6e57915594 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.356878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:29.358072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.358763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.359595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.360666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.362652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] PATH_INFO: `/v3/users/89c8aa2aa1644aa2bb872531b87e0e1c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.364869 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c8aa2aa1644aa2bb872531b87e0e1c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.367076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.367526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1076/2131] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:29.371389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.381697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda421f1-759c-4e55-86ba-c14badf2b4bb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.390737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.392258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.393420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.393801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.395588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:29.395800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.397963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.413545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1077/2132] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:24:29.417741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.420083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:29.427037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c8aa2aa1644aa2bb872531b87e0e1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.429151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d25d67-fe28-4630-9485-6a6ce36eb97b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.434872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.435598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.436102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.436473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.437233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.437514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c8aa2aa1644aa2bb872531b87e0e1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.438219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c8aa2aa1644aa2bb872531b87e0e1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.438833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c8aa2aa1644aa2bb872531b87e0e1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.439528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.447622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1846dd5c-9227-4d5c-bfd5-b409438d328e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c8aa2aa1644aa2bb872531b87e0e1c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:29.470428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1056/2133] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:29 2022] DELETE /identity/v3/users/89c8aa2aa1644aa2bb872531b87e0e1c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:29.473426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1078/2134] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:29 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:29.475860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.476155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.476707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.477691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.490066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.502678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:29.504419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.585320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1057/2135] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:29.597094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.599251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.600090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151f453-df3c-42c4-b080-60bc4235a119 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.609539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.610160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.610432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.610700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.612942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.617176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.648175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1079/2136] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:29 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:29.649448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.661344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128e01a-b5c0-4e9f-9e60-db0ae64b1a78 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.667047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.668326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.668849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.669317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.670306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.672114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.687578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1080/2137] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:29.688603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.700071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3808-b8d8-41d7-96ef-665323029d58 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.706663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ebcb-6e30-4aee-a25a-7e7b158310a8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.707212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.708892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.708892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.709128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.709703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.711331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.713898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69073140-f108-4b66-958f-25990785e75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.714900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073140-f108-4b66-958f-25990785e75f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.715519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073140-f108-4b66-958f-25990785e75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.715993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69073140-f108-4b66-958f-25990785e75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.728706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69073140-f108-4b66-958f-25990785e75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.730384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1081/2138] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:29.731001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69073140-f108-4b66-958f-25990785e75f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.732473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.744523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1058/2139] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:29.750698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fc60-dcef-4b58-b0fe-97565949e482 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:29.757374 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:29.758142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.758487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.758835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] PATH_INFO: `/v3/projects/4f6a283abe66448fa777446a340cdd24/users/f0aee792cde84d38bc58c43309271766/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.778051 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6a283abe66448fa777446a340cdd24, user_id=f0aee792cde84d38bc58c43309271766, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:29.781905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:29.798771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:29.807520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1082/2140] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:29 2022] PUT /identity/v3/projects/4f6a283abe66448fa777446a340cdd24/users/f0aee792cde84d38bc58c43309271766/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:29.812879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:29.813052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:29.813369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:29.844827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:29.846714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:29.936564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1059/2141] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:29.949838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:29.952136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:30.073540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:30.073677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:30.083152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:30.095585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69c035-0144-4eba-a31f-890fcbcd8fd1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:30.114267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:30.115118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:30.115496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:30.115852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] PATH_INFO: `/v3/projects/5b9a29be87f14219874738b35af86fcd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:30.117410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9a29be87f14219874738b35af86fcd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:30.119631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:30.148255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70234ef-1398-4fb1-9ab4-640ddaff153f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:30.161270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:30.161942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:30.164398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:30.164711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:30.183617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:30.185198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:30.196220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1083/2142] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:30.213307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9a29be87f14219874738b35af86fcd', 'request_id': 'req-cc983129-ed34-4896-ad0d-9b0ab63e99a7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:30.224320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9a29be87f14219874738b35af86fcd', 'request_id': 'req-cc983129-ed34-4896-ad0d-9b0ab63e99a7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:30.240223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9a29be87f14219874738b35af86fcd', 'request_id': 'req-cc983129-ed34-4896-ad0d-9b0ab63e99a7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:30.253222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] The token cache is being invalidate because project 5b9a29be87f14219874738b35af86fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:30.253518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:30.254284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cc983129-ed34-4896-ad0d-9b0ab63e99a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:30.256162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1060/2143] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:30 2022] DELETE /identity/v3/projects/5b9a29be87f14219874738b35af86fcd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:31.346338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:31.347794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:31.366253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364d00-3774-4896-8203-ff5087999d37 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:31.424922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:31.426265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:31.426749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:31.427014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] PATH_INFO: `/v3/users/c7bb109ef6994c558f4d8af2fcd8232e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:31.428155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bb109ef6994c558f4d8af2fcd8232e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:31.430098 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:31.503737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bb109ef6994c558f4d8af2fcd8232e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:31.504395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bb109ef6994c558f4d8af2fcd8232e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:31.505036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bb109ef6994c558f4d8af2fcd8232e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:31.514021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bb109ef6994c558f4d8af2fcd8232e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:31.525414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bb109ef6994c558f4d8af2fcd8232e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:31.552872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1084/2144] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:31 2022] DELETE /identity/v3/users/c7bb109ef6994c558f4d8af2fcd8232e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:31.556572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:31.557115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:31.557223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:31.582834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:31.593862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:31.676479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1061/2145] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:31.683312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:31.685994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:31.747519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:31.819879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879da60-8864-4165-bfb1-ca8ae70fe83c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:31.825150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:31.826207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:31.826731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:31.827205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:31.842201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:31.844806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:31.872720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1085/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:24:32.213233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:32.215047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:32.231321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0fbba-c47a-40e2-9ffb-f0dbd2cabdfc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:32.236809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:32.237604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:32.238602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:32.239590 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] PATH_INFO: `/v3/projects/bfae937c94f648b9a1a3d6eaf9eed68e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:32.241059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfae937c94f648b9a1a3d6eaf9eed68e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:32.243260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:32.323769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfae937c94f648b9a1a3d6eaf9eed68e', 'request_id': 'req-19436862-18f0-4084-88fd-296a57b8534d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.333406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfae937c94f648b9a1a3d6eaf9eed68e', 'request_id': 'req-19436862-18f0-4084-88fd-296a57b8534d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.341475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfae937c94f648b9a1a3d6eaf9eed68e', 'request_id': 'req-19436862-18f0-4084-88fd-296a57b8534d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.356591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] The token cache is being invalidate because project bfae937c94f648b9a1a3d6eaf9eed68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:32.356915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.357986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.359872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1062/2147] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:32 2022] DELETE /identity/v3/projects/bfae937c94f648b9a1a3d6eaf9eed68e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:32.365340 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:32.377436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce119be-bec8-46e3-8711-8dad6aa6e36a service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:32.444593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:32.445345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:32.445691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:32.446172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] PATH_INFO: `/v3/users/c73275c998c64426a2b818b051a066db` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:32.447390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73275c998c64426a2b818b051a066db)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:32.450014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:32.518901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73275c998c64426a2b818b051a066db'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.519928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73275c998c64426a2b818b051a066db'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.520685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73275c998c64426a2b818b051a066db'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.537043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73275c998c64426a2b818b051a066db'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.548955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73275c998c64426a2b818b051a066db'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:32.588639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1086/2148] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:32 2022] DELETE /identity/v3/users/c73275c998c64426a2b818b051a066db => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:33.101006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:33.102811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:33.126665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19436862-18f0-4084-88fd-296a57b8534d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:33.142332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:33.264838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:33.266361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:33.266875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:33.267355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] PATH_INFO: `/v3/projects/02c14c9870d24ad5b8f692a50177e6e1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:33.270789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c14c9870d24ad5b8f692a50177e6e1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:33.273944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:33.344670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c14c9870d24ad5b8f692a50177e6e1', 'request_id': 'req-14986318-8471-4f0b-90ec-67a07975abd2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.356841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c14c9870d24ad5b8f692a50177e6e1', 'request_id': 'req-14986318-8471-4f0b-90ec-67a07975abd2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.371745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c14c9870d24ad5b8f692a50177e6e1', 'request_id': 'req-14986318-8471-4f0b-90ec-67a07975abd2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.398006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] The token cache is being invalidate because project 02c14c9870d24ad5b8f692a50177e6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:33.402284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.403017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.404546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1063/2149] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:33 2022] DELETE /identity/v3/projects/02c14c9870d24ad5b8f692a50177e6e1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:33.409440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:33.411907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:33.436352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3a951-11fb-4d28-be81-db6a75443f0a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:33.485189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:33.506309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:33.507335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:33.507475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:33.507634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] PATH_INFO: `/v3/users/4d1b717fc9f141febfcb0587990e26ab` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:33.509247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1b717fc9f141febfcb0587990e26ab)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:33.511325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:33.585364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1b717fc9f141febfcb0587990e26ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.586426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1b717fc9f141febfcb0587990e26ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.587044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1b717fc9f141febfcb0587990e26ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.604410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1b717fc9f141febfcb0587990e26ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.618644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fe9f47f0-dd47-4160-a829-5d20a31a05a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1b717fc9f141febfcb0587990e26ab'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:33.645941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1087/2150] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:33 2022] DELETE /identity/v3/users/4d1b717fc9f141febfcb0587990e26ab => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:33.994361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:33.995980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:34.021257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14986318-8471-4f0b-90ec-67a07975abd2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.108437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.109239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.109734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.110073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] PATH_INFO: `/v3/projects/8d96e36a09af41e9af7a4d3e2d340535` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.111273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d96e36a09af41e9af7a4d3e2d340535)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.114202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.167990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:34.177510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d96e36a09af41e9af7a4d3e2d340535', 'request_id': 'req-b510f54b-4d01-4bcb-927c-411668dd5b4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:34.187865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d96e36a09af41e9af7a4d3e2d340535', 'request_id': 'req-b510f54b-4d01-4bcb-927c-411668dd5b4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:34.197265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d96e36a09af41e9af7a4d3e2d340535', 'request_id': 'req-b510f54b-4d01-4bcb-927c-411668dd5b4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:34.211484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] The token cache is being invalidate because project 8d96e36a09af41e9af7a4d3e2d340535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:34.212187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:34.213100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b510f54b-4d01-4bcb-927c-411668dd5b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:34.214973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1064/2151] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:33 2022] DELETE /identity/v3/projects/8d96e36a09af41e9af7a4d3e2d340535 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:34.221336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.221622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.221908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.244144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:34.245713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:34.327269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1088/2152] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:34.336094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.336452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.336921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.358428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:34.359839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:34.369655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1065/2153] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:34.374391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:34.391848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce377a9-e8af-43a5-a448-8b8bf7cd25ef None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.407638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.409263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.409425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.412864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.413688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:34.414005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.417995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.466764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1089/2154] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:24:34.471744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:34.487879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbef18d-f6db-400c-b73a-3baa1914081f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.512186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.513778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.514259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.514711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.515496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.518864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.557049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1066/2155] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:34 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:34.563475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:34.584294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab37e8-cb59-40d2-bc39-41a189fae6fb admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.680222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:34.712520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.713164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.714163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.714163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.714522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.717225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.743269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1090/2156] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:34 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:34.747555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:34.764300 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f8ddf-965b-4098-ad77-c7b9219a5a15 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.772961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.774107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.774497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.774981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.776547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.779330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.813415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1067/2157] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:34.821623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:34.836306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288a9ab-a279-4822-8732-d39a0805ec82 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.842087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528ec20-e851-4e63-83bd-9495f434e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.843067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ec20-e851-4e63-83bd-9495f434e436 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.843498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ec20-e851-4e63-83bd-9495f434e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.843918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ec20-e851-4e63-83bd-9495f434e436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.844711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528ec20-e851-4e63-83bd-9495f434e436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.846904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528ec20-e851-4e63-83bd-9495f434e436 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.864261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1091/2158] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:34.867495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:34.885582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90951824-e2bb-4235-9039-2ba1e172503d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:34.896517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:34.897345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.897671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.897978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] PATH_INFO: `/v3/projects/b185c3ae145a4d1fbc1c3d2ab5d4f10f/users/daeb491c00dd47038cce66e8710394c5/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.917371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b185c3ae145a4d1fbc1c3d2ab5d4f10f, user_id=daeb491c00dd47038cce66e8710394c5, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:34.922384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:34.941740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1068/2159] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:34 2022] PUT /identity/v3/projects/b185c3ae145a4d1fbc1c3d2ab5d4f10f/users/daeb491c00dd47038cce66e8710394c5/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:34.957341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:34.957872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:34.958329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:34.992348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] MFA Rules not processed for user `daeb491c00dd47038cce66e8710394c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:34.994060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:35.086341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1092/2160] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:35.090951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.195817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104901b-e1d2-4f87-b932-f881df98126d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.201598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.202214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.202760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.203034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.203676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.205649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.244549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1069/2161] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:35.246040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.258285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aadfe-54b6-4906-b3bb-389818008319 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.328859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.329467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.329740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.330008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.330633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.333357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.369804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1093/2162] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:35.372081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.391217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde74c8-7ab5-4dbf-904d-ed3d73f5bcae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.409415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.415667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.416010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.416289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.420635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.422711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.437793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1070/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:35.440420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.454042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa266c-bf9c-4752-aa1a-ad81c3a3e449 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.464598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2f10b-fcf8-47f3-8b30-319e096d42b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.466185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2f10b-fcf8-47f3-8b30-319e096d42b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.466185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2f10b-fcf8-47f3-8b30-319e096d42b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.466185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2f10b-fcf8-47f3-8b30-319e096d42b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.466686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2f10b-fcf8-47f3-8b30-319e096d42b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.468401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2f10b-fcf8-47f3-8b30-319e096d42b9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.487890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1094/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:35.492700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.507284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b94bc0-9d7f-48b7-9e59-4cc79a502f3a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.522243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a05e3-f5bd-49f2-93a5-0206e243ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.522940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a05e3-f5bd-49f2-93a5-0206e243ed62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.523216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a05e3-f5bd-49f2-93a5-0206e243ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.523626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a05e3-f5bd-49f2-93a5-0206e243ed62 admin admin] PATH_INFO: `/v3/projects/c0b9a45fb8a94cefab57189d5952c46c/users/07f12aed57ff481e97be63be55723cf2/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.550860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a05e3-f5bd-49f2-93a5-0206e243ed62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b9a45fb8a94cefab57189d5952c46c, user_id=07f12aed57ff481e97be63be55723cf2, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.565511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a05e3-f5bd-49f2-93a5-0206e243ed62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.577101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1071/2165] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:35 2022] PUT /identity/v3/projects/c0b9a45fb8a94cefab57189d5952c46c/users/07f12aed57ff481e97be63be55723cf2/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:35.589633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.590268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.590641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.622723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] MFA Rules not processed for user `07f12aed57ff481e97be63be55723cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:35.624700 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:35.662171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.662453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.662723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.663529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:35.699650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] MFA Rules not processed for user `f0aee792cde84d38bc58c43309271766`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:35.700918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:35.709316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:35.743311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1095/2166] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:35.747278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.839425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1072/2167] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:35.845632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.847312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:35.854428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad616db-5d36-424a-8540-d09a04c61885 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.860111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.863753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd210-a25e-4d13-9cc6-dbad41fe9c05 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:35.869383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.869658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:35.869850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.870128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:35.870328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.870488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:35.870786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:35.871088 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.871433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:35.873404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.873973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:35.921185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1096/2168] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:35.922868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:35.928644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1073/2169] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:35.932783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.026395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210506b9-0ea4-4ae4-89b5-5c0477a052c7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.031959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.032567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.032875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.033159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.033833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.036127 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.040727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9c48-f4c1-4812-b0cd-78a64e7aadf3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.045712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.046426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.046856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.047133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.047783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.049775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.062958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1074/2170] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:36.064276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.077023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93168019-6b90-4cde-85db-695483eac4bf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.079782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1097/2171] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:35 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:36.084470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.090242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.090875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.091156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.091430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.092087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.094509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.096417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9bee7-0890-4e1b-9415-380417b63b45 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.102689 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.103427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.103771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.104110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.104933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.106667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.110151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1075/2172] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:36.111012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.121189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10067-e07b-4f36-aa4b-e48e383b939c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.122601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1098/2173] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:36.125979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.126542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.126678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.126913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.127185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] PATH_INFO: `/v3/projects/a46512ebdcfb452399eff7978c1d9fcc/users/0cc25713e47c435abd2ef0ac7575d975/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.137520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc237-8f76-4f73-a2b3-18480aa71899 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.142483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.143408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.144844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.145216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] PATH_INFO: `/v3/projects/6823368f9752449b95b0741ebca5b121/users/50176b1637594dce83ccb78053a5fb42/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.148064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46512ebdcfb452399eff7978c1d9fcc, user_id=0cc25713e47c435abd2ef0ac7575d975, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.150775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.162740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6823368f9752449b95b0741ebca5b121, user_id=50176b1637594dce83ccb78053a5fb42, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.165404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.166516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1076/2174] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:36 2022] PUT /identity/v3/projects/a46512ebdcfb452399eff7978c1d9fcc/users/0cc25713e47c435abd2ef0ac7575d975/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:36.170548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.182492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1099/2175] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:36 2022] PUT /identity/v3/projects/6823368f9752449b95b0741ebca5b121/users/50176b1637594dce83ccb78053a5fb42/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:36.188149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.199323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:36.226743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:36.269850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b121-ee32-4a5c-bef0-8ad5e0728c4f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.316585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5e91e-6e73-48bb-a5a1-6f79b11205e0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.329527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.331280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.332091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.333133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.335257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.339636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.359787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1100/2176] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:36.365439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.376230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb670-b20b-43f4-a099-aebe90e2af1a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.381875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.381875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.382167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.382331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.382967 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.383976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44639f6f-8d32-4052-acf4-19120f65f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.384800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.385050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44639f6f-8d32-4052-acf4-19120f65f72c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.386884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44639f6f-8d32-4052-acf4-19120f65f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.386884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44639f6f-8d32-4052-acf4-19120f65f72c admin admin] PATH_INFO: `/v3/projects/6823368f9752449b95b0741ebca5b121/users/50176b1637594dce83ccb78053a5fb42/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.390323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44639f6f-8d32-4052-acf4-19120f65f72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6823368f9752449b95b0741ebca5b121, user_id=50176b1637594dce83ccb78053a5fb42, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.393106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44639f6f-8d32-4052-acf4-19120f65f72c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.397642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1077/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:24:36.402208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.415185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1101/2178] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:36 2022] PUT /identity/v3/projects/6823368f9752449b95b0741ebca5b121/users/50176b1637594dce83ccb78053a5fb42/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:36.418562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947623bb-8c4b-4cf1-947e-04aa5c5011a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.426668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.427085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.427452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.461001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] MFA Rules not processed for user `50176b1637594dce83ccb78053a5fb42`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:36.462322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:36.490063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.491063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.491346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.491622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] PATH_INFO: `/v3/projects/a46512ebdcfb452399eff7978c1d9fcc/users/0cc25713e47c435abd2ef0ac7575d975/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.493632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46512ebdcfb452399eff7978c1d9fcc, user_id=0cc25713e47c435abd2ef0ac7575d975, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.496521 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.508681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1078/2179] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:36 2022] PUT /identity/v3/projects/a46512ebdcfb452399eff7978c1d9fcc/users/0cc25713e47c435abd2ef0ac7575d975/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:36.599791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1102/2180] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:36.624046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:36.630578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:36.749589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b3c1-5a5a-486f-8423-a16b7dfb52cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:36.758834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:36.759599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:36.759945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:36.760279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:36.798396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:36.858988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:36.860744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:36.878810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1079/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:38.774015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:38.880661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db32a-fcb2-4b3f-a29f-32c63277cfa4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:38.885683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c47f2a-ea5c-4413-8754-e39077fe3922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:38.886453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47f2a-ea5c-4413-8754-e39077fe3922 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:38.886887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47f2a-ea5c-4413-8754-e39077fe3922 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:38.887238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47f2a-ea5c-4413-8754-e39077fe3922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:38.932765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:38.976840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c47f2a-ea5c-4413-8754-e39077fe3922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:38.981320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c47f2a-ea5c-4413-8754-e39077fe3922 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:39.003794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1103/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:40.046804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:40.048265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:40.074817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb344c-6a35-4af8-9b78-4df6bf20390a service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:40.086078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:40.086708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:40.087063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:40.087245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:40.228805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:40.230767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:40.244131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1080/2183] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:42.276747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfd99-0e94-4ede-9c33-6ae2831656d2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:42.277324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfd99-0e94-4ede-9c33-6ae2831656d2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:42.277594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfd99-0e94-4ede-9c33-6ae2831656d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:42.312593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-558cfd99-0e94-4ede-9c33-6ae2831656d2 None None] MFA Rules not processed for user `0cc25713e47c435abd2ef0ac7575d975`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:42.313909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-558cfd99-0e94-4ede-9c33-6ae2831656d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:42.387227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1104/2184] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:42.401815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:42.403285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:42.482916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9a39-c950-4589-96d0-cf006d7425c4 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:42.489188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:42.489942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:42.490225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:42.490490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:42.553184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:42.554790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:42.559997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:42.565867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1081/2185] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:43.842383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62dc3f-0373-4d29-b812-1e75049686ed None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:43.842848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62dc3f-0373-4d29-b812-1e75049686ed None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:43.843127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62dc3f-0373-4d29-b812-1e75049686ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:43.864047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4d62dc3f-0373-4d29-b812-1e75049686ed None None] MFA Rules not processed for user `f0aee792cde84d38bc58c43309271766`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:43.865544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4d62dc3f-0373-4d29-b812-1e75049686ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:43.872480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1105/2186] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:44.547731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:44.617422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f370-1a40-4f2b-b674-42245a598c7f service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:44.623171 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:44.624135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:44.624417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:44.624832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] PATH_INFO: `/v3/users/daeb491c00dd47038cce66e8710394c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:44.626025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] RBAC: Authorizing `identity:delete_user(user_id=daeb491c00dd47038cce66e8710394c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:44.628122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:44.680664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daeb491c00dd47038cce66e8710394c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:44.688725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daeb491c00dd47038cce66e8710394c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:44.689621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daeb491c00dd47038cce66e8710394c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:44.690561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daeb491c00dd47038cce66e8710394c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:44.701897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daeb491c00dd47038cce66e8710394c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:44.728243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:44.728518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:44.728806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:44.732919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1082/2187] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:44 2022] DELETE /identity/v3/users/daeb491c00dd47038cce66e8710394c5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:44.753276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:44.754746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:44.835815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1106/2188] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:44.846442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:44.847903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:44.911901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b304c0-7628-498d-8173-c228999e906e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:44.918637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:44.919766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:44.920211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:44.920614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:44.930982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:44.932456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:44.944140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1083/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:45.281762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:45.283306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:45.301533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3254e-ed87-4d8b-8d1b-a2806acbf358 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:45.306702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:45.307413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:45.307754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:45.308245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] PATH_INFO: `/v3/projects/b185c3ae145a4d1fbc1c3d2ab5d4f10f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:45.309742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b185c3ae145a4d1fbc1c3d2ab5d4f10f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:45.311828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:45.378866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:45.383502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b185c3ae145a4d1fbc1c3d2ab5d4f10f', 'request_id': 'req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.395912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b185c3ae145a4d1fbc1c3d2ab5d4f10f', 'request_id': 'req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.405996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b185c3ae145a4d1fbc1c3d2ab5d4f10f', 'request_id': 'req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.428758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] The token cache is being invalidate because project b185c3ae145a4d1fbc1c3d2ab5d4f10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:45.429187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.429927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.432823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1107/2190] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:45 2022] DELETE /identity/v3/projects/b185c3ae145a4d1fbc1c3d2ab5d4f10f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:45.435663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:45.446491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea54ce-6ae6-447b-b391-cf22afc40082 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:45.484684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:45.553603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:45.554997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:45.555949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:45.556374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] PATH_INFO: `/v3/users/07f12aed57ff481e97be63be55723cf2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:45.558175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f12aed57ff481e97be63be55723cf2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:45.560323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:45.632958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f12aed57ff481e97be63be55723cf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.641819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f12aed57ff481e97be63be55723cf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.642529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f12aed57ff481e97be63be55723cf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.643136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f12aed57ff481e97be63be55723cf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.652107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f12aed57ff481e97be63be55723cf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:45.681473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1084/2191] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:45 2022] DELETE /identity/v3/users/07f12aed57ff481e97be63be55723cf2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:46.022503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:46.024034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:46.040765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0f2fe-3f65-43ca-b843-63e7be20d5f1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:46.109595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:46.110378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:46.110709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:46.111031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] PATH_INFO: `/v3/projects/c0b9a45fb8a94cefab57189d5952c46c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:46.113627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b9a45fb8a94cefab57189d5952c46c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:46.115602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:46.171503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b9a45fb8a94cefab57189d5952c46c', 'request_id': 'req-40b9a774-2c19-4b7d-aae5-2c8e87f43531'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.179246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b9a45fb8a94cefab57189d5952c46c', 'request_id': 'req-40b9a774-2c19-4b7d-aae5-2c8e87f43531'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.185308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b9a45fb8a94cefab57189d5952c46c', 'request_id': 'req-40b9a774-2c19-4b7d-aae5-2c8e87f43531'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.201364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] The token cache is being invalidate because project c0b9a45fb8a94cefab57189d5952c46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:46.201924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.202838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.204348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1108/2192] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:46 2022] DELETE /identity/v3/projects/c0b9a45fb8a94cefab57189d5952c46c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:46.208583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:46.210108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:46.223514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f875e4-26de-47d3-b6e5-8bcbf2f83049 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:46.285638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:46.286279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:46.286710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:46.286989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] PATH_INFO: `/v3/users/50176b1637594dce83ccb78053a5fb42` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:46.288175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50176b1637594dce83ccb78053a5fb42)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:46.290188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:46.338837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:46.341481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50176b1637594dce83ccb78053a5fb42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.350963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50176b1637594dce83ccb78053a5fb42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.351989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50176b1637594dce83ccb78053a5fb42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.352608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50176b1637594dce83ccb78053a5fb42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.360538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a34035d-81f9-4f4e-93e1-4574b33d30e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50176b1637594dce83ccb78053a5fb42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.380278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1085/2193] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:24:46 2022] DELETE /identity/v3/users/50176b1637594dce83ccb78053a5fb42 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:46.740101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:46.741955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:46.769904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9a774-2c19-4b7d-aae5-2c8e87f43531 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:46.856451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:46.857124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:46.857474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:46.857815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] PATH_INFO: `/v3/projects/6823368f9752449b95b0741ebca5b121` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:46.861183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6823368f9752449b95b0741ebca5b121)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:46.864111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:46.868328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:46.947148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6823368f9752449b95b0741ebca5b121', 'request_id': 'req-a0486574-b70d-417c-a351-99fd98caf19f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.954223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6823368f9752449b95b0741ebca5b121', 'request_id': 'req-a0486574-b70d-417c-a351-99fd98caf19f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.961558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6823368f9752449b95b0741ebca5b121', 'request_id': 'req-a0486574-b70d-417c-a351-99fd98caf19f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.977598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] The token cache is being invalidate because project 6823368f9752449b95b0741ebca5b121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:24:46.978125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.979028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a0486574-b70d-417c-a351-99fd98caf19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:24:46.980638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1109/2194] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:24:46 2022] DELETE /identity/v3/projects/6823368f9752449b95b0741ebca5b121 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:24:46.990252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:46.990769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:46.990860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.014140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:47.015489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:47.083837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1086/2195] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:47.091709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.091988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.092257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.114117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:47.115370 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:47.123380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1110/2196] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:47.128323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.138459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbdda8-e1f4-478b-9ce6-8e02a44e3651 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.142906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.144163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.144651 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.145027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.145685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:24:47.145990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.147624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.160136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1087/2197] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:24:47.164607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.173764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d241-49b9-4ecb-b895-6a0304af1bc2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.179015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.179608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.179883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.180151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.180797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.182693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.214909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1111/2198] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:24:47 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:24:47.216082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.226666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa35ff-d5a3-4acf-ae7b-88717318fa1d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.285278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.285887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.286168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.286440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.287087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.289068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.310553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1088/2199] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:24:47 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:24:47.314823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.326796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96fff-71e2-40ae-af25-6388d00b1d39 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.332526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.333200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.333487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.333753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.334391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.336112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.346397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1112/2200] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:47.350516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.361749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab777-8c09-4799-945e-e8a0e9dd7f92 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.366332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fec01-a99e-40cb-af79-58f34605db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.366927 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fec01-a99e-40cb-af79-58f34605db2f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.367201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fec01-a99e-40cb-af79-58f34605db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.367465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fec01-a99e-40cb-af79-58f34605db2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.368126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fec01-a99e-40cb-af79-58f34605db2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.369726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fec01-a99e-40cb-af79-58f34605db2f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.380886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1089/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:24:47.385135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.396185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42340e-8e54-4065-9bf1-6752ab876fe0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.401037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.401690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.401962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.402236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] PATH_INFO: `/v3/projects/45c225d183e349c8b115a7b5af2008ed/users/8d5adfa5fb7a49baa17a45abcc2b2528/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.417077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c225d183e349c8b115a7b5af2008ed, user_id=8d5adfa5fb7a49baa17a45abcc2b2528, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.419702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.433970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1113/2202] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:24:47 2022] PUT /identity/v3/projects/45c225d183e349c8b115a7b5af2008ed/users/8d5adfa5fb7a49baa17a45abcc2b2528/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:24:47.446155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6f19-57aa-47b7-a380-5ee6aa30adc0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.446439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6f19-57aa-47b7-a380-5ee6aa30adc0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.446709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6f19-57aa-47b7-a380-5ee6aa30adc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.475951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1c2c6f19-57aa-47b7-a380-5ee6aa30adc0 None None] MFA Rules not processed for user `8d5adfa5fb7a49baa17a45abcc2b2528`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:47.477211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1c2c6f19-57aa-47b7-a380-5ee6aa30adc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:47.490461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:47.547290 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1090/2203] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:47.560343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:47.562868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:47.622125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a25f-a9bc-4697-9d77-8205d25fd040 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:47.625883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:47.626495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:47.626770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:47.627039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:47.637041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:47.638521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:47.648091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1114/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:52.012962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9641c5-9410-4df1-b7b4-692f7df3a8c8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:52.013992 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9641c5-9410-4df1-b7b4-692f7df3a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:52.014266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9641c5-9410-4df1-b7b4-692f7df3a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:52.052324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ea9641c5-9410-4df1-b7b4-692f7df3a8c8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:52.053690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ea9641c5-9410-4df1-b7b4-692f7df3a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:52.124391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1091/2205] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:24:52.147490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:52.148846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:52.183442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:52.226829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a3b7d-c50d-40c5-8c88-34042712d785 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:52.233574 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:52.234171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:52.234500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:52.234770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:52.244382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:52.246058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:52.256339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1115/2206] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:58.032514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5f93-1666-428c-a9b6-4ec69504838a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:58.033570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5f93-1666-428c-a9b6-4ec69504838a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:58.034044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5f93-1666-428c-a9b6-4ec69504838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:58.064463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-716c5f93-1666-428c-a9b6-4ec69504838a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:58.071691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-716c5f93-1666-428c-a9b6-4ec69504838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:58.081674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1092/2207] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:24:58.098189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:24:58.099748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:58.118691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ed13-18da-4680-8432-7799a3585e22 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:24:58.124189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5e37-f5d8-46f7-a5f4-aa406129a58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:24:58.125193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5e37-f5d8-46f7-a5f4-aa406129a58e service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:58.125471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5e37-f5d8-46f7-a5f4-aa406129a58e service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:58.125823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5e37-f5d8-46f7-a5f4-aa406129a58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:58.135467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced5e37-f5d8-46f7-a5f4-aa406129a58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:24:58.137078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced5e37-f5d8-46f7-a5f4-aa406129a58e service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:24:58.147303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1116/2208] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:24:58.310789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6e20-296d-4854-a9b9-8d626ae52023 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:24:58.311076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6e20-296d-4854-a9b9-8d626ae52023 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:24:58.311347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6e20-296d-4854-a9b9-8d626ae52023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:24:58.336086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-181d6e20-296d-4854-a9b9-8d626ae52023 None None] MFA Rules not processed for user `778f3756020548dda6e0162f5560a328`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:24:58.337477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-181d6e20-296d-4854-a9b9-8d626ae52023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:24:58.393411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1093/2209] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:00.918151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:00.918544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:00.918853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:00.941380 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] MFA Rules not processed for user `6ebfeba30aa342a99e0d5855f9ac8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:00.942609 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:01.056897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1117/2210] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:02.465979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3073-e404-46cb-8ce0-bb710701f071 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:02.467499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3073-e404-46cb-8ce0-bb710701f071 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:02.467961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3073-e404-46cb-8ce0-bb710701f071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:02.508173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ac2f3073-e404-46cb-8ce0-bb710701f071 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:02.510798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac2f3073-e404-46cb-8ce0-bb710701f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:02.530942 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1094/2211] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:02.546882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:02.577873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9331bb-b477-4c2e-965b-e01e043d27ae None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:02.586204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:02.587122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:02.587808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:02.588430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:02.600102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:02.602306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:02.625186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1118/2212] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:06.550616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5c924-ad46-4111-bee7-dad3d57a5dce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:06.551103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5c924-ad46-4111-bee7-dad3d57a5dce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:06.551340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5c924-ad46-4111-bee7-dad3d57a5dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:06.578728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b7f5c924-ad46-4111-bee7-dad3d57a5dce None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:06.580586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7f5c924-ad46-4111-bee7-dad3d57a5dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:06.589195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1095/2213] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:25:06.604263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:06.615421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965d11b-b128-4a44-90d8-aa57ba93311d service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:06.620802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:06.621391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:06.621671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:06.621934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:06.630632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:06.632224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:06.644247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1119/2214] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:10.804314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338281d4-214d-4015-96b1-adab831ef549 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:10.805269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338281d4-214d-4015-96b1-adab831ef549 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:10.805604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338281d4-214d-4015-96b1-adab831ef549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:10.839251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-338281d4-214d-4015-96b1-adab831ef549 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:10.840690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-338281d4-214d-4015-96b1-adab831ef549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:10.851328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1096/2215] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:10.874126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:10.902656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78884055-6652-4fad-a1d3-ac3a10e4ba48 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:10.908932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:10.909552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:10.909895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:10.910244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:10.919383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:10.921000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:10.933950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1120/2216] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:15.053038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:15.053586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:15.053719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:15.077261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:15.085286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:15.089704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1097/2217] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:15.115375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:15.127614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81728832-4c2d-46da-b180-80cf39456d8f service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:15.133142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcc22-a5b8-4b71-b403-b7fe85f5842e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:15.133728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcc22-a5b8-4b71-b403-b7fe85f5842e service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:15.134001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcc22-a5b8-4b71-b403-b7fe85f5842e service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:15.134266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcc22-a5b8-4b71-b403-b7fe85f5842e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:15.143854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcc22-a5b8-4b71-b403-b7fe85f5842e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:15.145537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcc22-a5b8-4b71-b403-b7fe85f5842e service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:15.155823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1121/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:22.650190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:22.655047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:22.661523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9132ec-3e98-4134-b0cc-f2a98df3643f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:22.666124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:22.666771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:22.667046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:22.667310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] PATH_INFO: `/v3/users/8d5adfa5fb7a49baa17a45abcc2b2528` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:22.668406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5adfa5fb7a49baa17a45abcc2b2528)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:22.670402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:22.719539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5adfa5fb7a49baa17a45abcc2b2528'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:22.737299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5adfa5fb7a49baa17a45abcc2b2528'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:22.738638 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5adfa5fb7a49baa17a45abcc2b2528'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:22.739679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5adfa5fb7a49baa17a45abcc2b2528'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:22.746894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5adfa5fb7a49baa17a45abcc2b2528'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:22.765124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1098/2219] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:22 2022] DELETE /identity/v3/users/8d5adfa5fb7a49baa17a45abcc2b2528 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:22.770226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:22.770755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:22.771186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:22.778842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=76 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:22.799684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:22.801231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:22.862667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1122/2220] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:22.872671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:22.874147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:22.930580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162566be-bde7-48c1-870a-bb48d6fe524f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:22.934210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05bc28-214c-43de-bf19-706ed4af6270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:22.934806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05bc28-214c-43de-bf19-706ed4af6270 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:22.935081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05bc28-214c-43de-bf19-706ed4af6270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:22.935360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05bc28-214c-43de-bf19-706ed4af6270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:22.945213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05bc28-214c-43de-bf19-706ed4af6270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:22.946903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05bc28-214c-43de-bf19-706ed4af6270 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:22.956514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1099/2221] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:23.347151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.349141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:23.379733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54902f-1e51-460f-97fb-0d8edfb8b714 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.390406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.391998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.392382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.393530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] PATH_INFO: `/v3/projects/45c225d183e349c8b115a7b5af2008ed` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.405896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c225d183e349c8b115a7b5af2008ed)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.409228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.486753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c225d183e349c8b115a7b5af2008ed', 'request_id': 'req-0154c61f-8c25-43a7-b03a-1c6436fa0f00'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:23.493250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c225d183e349c8b115a7b5af2008ed', 'request_id': 'req-0154c61f-8c25-43a7-b03a-1c6436fa0f00'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:23.499781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c225d183e349c8b115a7b5af2008ed', 'request_id': 'req-0154c61f-8c25-43a7-b03a-1c6436fa0f00'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:23.513060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] The token cache is being invalidate because project 45c225d183e349c8b115a7b5af2008ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:23.513404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:23.514282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0154c61f-8c25-43a7-b03a-1c6436fa0f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:23.515855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1123/2222] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:23 2022] DELETE /identity/v3/projects/45c225d183e349c8b115a7b5af2008ed => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:23.521514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.522000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.522267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.551096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:23.552467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:23.611076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1100/2223] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:23.618694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.619002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.619276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.640208 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:23.641452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:23.649237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1124/2224] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:25:23.653574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.663389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818d92a-624d-491e-8ba8-d60c0fd93b58 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.667886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.668482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.668762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.669062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.669704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:23.670008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.671584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.683433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1101/2225] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:25:23.687590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.697394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bd21e-813d-4b84-816f-9e80890ddbca None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.702163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.702746 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.703013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.703272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.703883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.706110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.732783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1125/2226] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:23 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:23.737484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.743873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:23.747766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766e5b8-095c-4526-adc8-25cd616d420a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.807572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.808177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.808853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.808853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.809364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.811291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.835316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1102/2227] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:23 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:25:23.836629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.847502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fed7f1-238c-4288-b232-3cce1db9608f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.852136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.852718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.853025 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.853291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.853923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.855529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.866031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1126/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:23.869994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.881621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab00a-9ecc-45b7-a917-2d15ed443661 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.886250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acb66b-e278-4256-befb-6c2a81fa550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.886841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acb66b-e278-4256-befb-6c2a81fa550c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.887119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acb66b-e278-4256-befb-6c2a81fa550c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.887388 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acb66b-e278-4256-befb-6c2a81fa550c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.888026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acb66b-e278-4256-befb-6c2a81fa550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.889645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acb66b-e278-4256-befb-6c2a81fa550c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.900348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1103/2229] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:23.904410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:23.915239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac093d7a-99e4-4661-b73c-1e8b56bc29e3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:23.919755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:23.920384 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.920659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.920956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] PATH_INFO: `/v3/projects/13c67369cc8a45a6af4abf440f624436/users/8bd1a6cf9184467297223c4a22cdcd75/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.935838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c67369cc8a45a6af4abf440f624436, user_id=8bd1a6cf9184467297223c4a22cdcd75, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:23.938555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:23.952032 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1127/2230] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:23 2022] PUT /identity/v3/projects/13c67369cc8a45a6af4abf440f624436/users/8bd1a6cf9184467297223c4a22cdcd75/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:23.963367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebeaed-9c33-4521-a16b-843e9b8db58d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:23.963649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebeaed-9c33-4521-a16b-843e9b8db58d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:23.963919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebeaed-9c33-4521-a16b-843e9b8db58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:23.992798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-caebeaed-9c33-4521-a16b-843e9b8db58d None None] MFA Rules not processed for user `8bd1a6cf9184467297223c4a22cdcd75`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:23.994010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-caebeaed-9c33-4521-a16b-843e9b8db58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:24.060859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1104/2231] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:24.071518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:24.073216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:24.100223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:24.132440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fd78d-f731-4425-9fe7-9e7fb2625f82 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:24.136020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:24.136647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:24.136953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:24.137244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:24.145608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:24.147019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:24.155602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1128/2232] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:29.667853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:29.668367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:29.668489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:29.711698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:29.712976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:29.799286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1105/2233] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:29.851604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:29.853297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:29.926123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a8d7-9ea8-42e1-a42e-620c340d6349 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:29.931085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:29.931682 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:29.931955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:29.932218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:29.943160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:29.943756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:29.954470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1129/2234] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:25:32.253190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:32.255328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:32.276306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:32.319882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21b22-2c14-4369-8193-3cee12ca0274 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:32.324194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:32.325001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:32.325356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:32.325657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:32.327659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:32.401249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:32.403599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086839f0-c3e9-438a-a09f-2c43351be0d2 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:32.414932 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1106/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:34.825668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:34.917377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed264c-8d4e-4966-b620-886641ad36bc service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:34.922767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:34.923585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:34.924015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:34.924454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] PATH_INFO: `/v3/users/8bd1a6cf9184467297223c4a22cdcd75` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:34.925836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd1a6cf9184467297223c4a22cdcd75)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:34.928106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:35.035547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd1a6cf9184467297223c4a22cdcd75'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.038172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd1a6cf9184467297223c4a22cdcd75'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.041050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd1a6cf9184467297223c4a22cdcd75'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.053546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd1a6cf9184467297223c4a22cdcd75'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.056138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:35.067288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd1a6cf9184467297223c4a22cdcd75'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.110107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1130/2236] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:25:34 2022] DELETE /identity/v3/users/8bd1a6cf9184467297223c4a22cdcd75 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:35.114354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:35.114877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:35.115089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:35.153547 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:35.154868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:35.240595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1107/2237] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:35.252240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:35.254995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:35.356950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6586-1aa1-4166-a4d8-046cc3eb5b6d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:35.361079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92d2ca-9c4e-489c-a749-6dd2bb2ce5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:35.362472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d2ca-9c4e-489c-a749-6dd2bb2ce5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:35.362767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d2ca-9c4e-489c-a749-6dd2bb2ce5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:35.364470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d2ca-9c4e-489c-a749-6dd2bb2ce5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:35.383246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92d2ca-9c4e-489c-a749-6dd2bb2ce5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:35.385573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92d2ca-9c4e-489c-a749-6dd2bb2ce5d3 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:35.414017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1131/2238] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:35.785737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:35.787384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:35.818461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f355bbe-c977-4f96-80a0-5c44db3d9cda None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:35.830146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:35.831285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:35.831852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:35.832659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] PATH_INFO: `/v3/projects/13c67369cc8a45a6af4abf440f624436` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:35.835769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c67369cc8a45a6af4abf440f624436)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:35.841220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:35.935446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c67369cc8a45a6af4abf440f624436', 'request_id': 'req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.943288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c67369cc8a45a6af4abf440f624436', 'request_id': 'req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.950693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c67369cc8a45a6af4abf440f624436', 'request_id': 'req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.953812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:35.965727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] The token cache is being invalidate because project 13c67369cc8a45a6af4abf440f624436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:25:35.966025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.966732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-50815ae4-e44e-41fd-bf4a-bceb117ddeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:25:35.968613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1108/2239] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:25:35 2022] DELETE /identity/v3/projects/13c67369cc8a45a6af4abf440f624436 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:35.974187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:35.974691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:35.974773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:35.996761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:35.998063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:36.096279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1132/2240] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:25:36.098105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.098439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.098747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.133898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:36.135131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:36.154576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.167339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1109/2241] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:36.168529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479808dc-579f-42a8-b5c7-91715d684c88 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.175499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.176287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.176644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.177020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.178216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:25:36.178604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.181325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.205544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1133/2242] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:25:36.206173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.231200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86d00-4a41-4259-b860-bbb1c49a40e9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.249814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.250834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.251112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.251381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.252754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.254148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.293739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.305040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec634d-2776-43d2-8280-bf7f4530844b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.306166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1110/2243] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:25:36.385814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.386503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.386787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.387057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.387848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.389845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.405911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:36.429522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1134/2244] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:36 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:36.433723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.445605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14a2c1-2357-4d17-89c1-ac71bdf0f4cd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.450690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.451291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.451832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.452098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.452754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.454443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.468747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1111/2245] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:36.472994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.485059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5721ed-20d9-47ee-8afd-01b05849ce55 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.490739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09263198-204a-43f5-89fc-48f5bc753245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.491534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263198-204a-43f5-89fc-48f5bc753245 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.491814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263198-204a-43f5-89fc-48f5bc753245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.492080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263198-204a-43f5-89fc-48f5bc753245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.492759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09263198-204a-43f5-89fc-48f5bc753245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.494366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09263198-204a-43f5-89fc-48f5bc753245 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.510388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1135/2246] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:36.514696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.525415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8d28-ac35-401e-8bb2-b14325c25867 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.530156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.530839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.531112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.531407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] PATH_INFO: `/v3/projects/44a86af4bfaa4136a85e853caea8fbd7/users/409a8ac347df45a298301b6aa773e34f/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.547974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a86af4bfaa4136a85e853caea8fbd7, user_id=409a8ac347df45a298301b6aa773e34f, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.551132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.568623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1112/2247] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:36 2022] PUT /identity/v3/projects/44a86af4bfaa4136a85e853caea8fbd7/users/409a8ac347df45a298301b6aa773e34f/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:25:36.573661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f55d9-0af7-4335-aafd-fb4a71f429e3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.577197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f55d9-0af7-4335-aafd-fb4a71f429e3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.577486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f55d9-0af7-4335-aafd-fb4a71f429e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.600887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-410f55d9-0af7-4335-aafd-fb4a71f429e3 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:36.602140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-410f55d9-0af7-4335-aafd-fb4a71f429e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:36.680087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1136/2248] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:36.686895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:36.689476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:36.708310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18bcf3-8b35-4a98-8716-1a9edc6b0f37 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.708310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18bcf3-8b35-4a98-8716-1a9edc6b0f37 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.708310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18bcf3-8b35-4a98-8716-1a9edc6b0f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.732657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9c18bcf3-8b35-4a98-8716-1a9edc6b0f37 None None] MFA Rules not processed for user `51bb880d57474b658f1cf85353c00743`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:36.733538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c18bcf3-8b35-4a98-8716-1a9edc6b0f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:36.796235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5ba3-0e44-4d32-ab73-90319ade6027 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:36.801176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:36.801980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:36.802437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:36.802871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:36.814278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:36.815590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1137/2249] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:25:36.816200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:36.831741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1113/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:43.932664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:43.933293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:43.933293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:43.962107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] MFA Rules not processed for user `409a8ac347df45a298301b6aa773e34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:43.963330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:44.028418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1138/2251] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:44.033073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:44.042759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcd18a-6f1a-4ccf-a95f-79c6513d250f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:44.047879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:44.048530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:44.048845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:44.049119 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:44.049748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:44.051645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:44.083070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1114/2252] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:25:44 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:44.084256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:44.096398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d8143-4ccc-49b6-9e9f-38055a9b75b9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:44.111592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:44.163114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:44.163797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:44.164137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:44.164466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:44.165188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:44.167163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:44.193007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1139/2253] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:25:44 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:25:44.197393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:44.209463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0093f-d459-407c-93c4-613f83562137 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:44.214202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:44.214988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:44.215266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:44.215530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:44.216162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:44.217770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:44.230687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1115/2254] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:44.235716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:44.246756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423269-5c75-4df7-9187-8ce346a7302e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:44.252455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:44.253605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:44.253894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:44.254167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] PATH_INFO: `/v3/projects/687ee3427a3b47ad940ba28947d79131/users/ade26dfd3de74c5d9549654155a0b995/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:44.270456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687ee3427a3b47ad940ba28947d79131, user_id=ade26dfd3de74c5d9549654155a0b995, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:44.273209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:44.287868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1140/2255] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:44 2022] PUT /identity/v3/projects/687ee3427a3b47ad940ba28947d79131/users/ade26dfd3de74c5d9549654155a0b995/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:44.291587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:44.301763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9678-c143-41ba-a042-fa93ec28f5a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:44.369533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:44.377494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e533b01-5b5c-4234-b57b-35a07353d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:44.378249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e533b01-5b5c-4234-b57b-35a07353d971 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:44.378762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e533b01-5b5c-4234-b57b-35a07353d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:44.379093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e533b01-5b5c-4234-b57b-35a07353d971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:44.379921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e533b01-5b5c-4234-b57b-35a07353d971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:44.381782 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e533b01-5b5c-4234-b57b-35a07353d971 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:44.394766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1116/2256] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:25:44.398929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:44.409984 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4faa5-3e41-44e5-bffe-fed17082e860 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:44.414658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb2b83-6300-41d0-bb7e-650e484eb80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:44.415301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb2b83-6300-41d0-bb7e-650e484eb80c admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:44.415573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb2b83-6300-41d0-bb7e-650e484eb80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:44.415834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb2b83-6300-41d0-bb7e-650e484eb80c admin admin] PATH_INFO: `/v3/projects/687ee3427a3b47ad940ba28947d79131/users/ade26dfd3de74c5d9549654155a0b995/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:44.417719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb2b83-6300-41d0-bb7e-650e484eb80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=687ee3427a3b47ad940ba28947d79131, user_id=ade26dfd3de74c5d9549654155a0b995, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:44.420401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb2b83-6300-41d0-bb7e-650e484eb80c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:44.432479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1141/2257] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:25:44 2022] PUT /identity/v3/projects/687ee3427a3b47ad940ba28947d79131/users/ade26dfd3de74c5d9549654155a0b995/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:25:49.056274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eacdc-370c-49af-b167-e7694247f0b6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.057078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eacdc-370c-49af-b167-e7694247f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.057501 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eacdc-370c-49af-b167-e7694247f0b6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.059786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1117/2258] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:25:49.069079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408903b6-f8bb-4bee-888c-1a24c1744bad None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.069447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408903b6-f8bb-4bee-888c-1a24c1744bad None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.069727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408903b6-f8bb-4bee-888c-1a24c1744bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.097082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-408903b6-f8bb-4bee-888c-1a24c1744bad None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:49.099043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-408903b6-f8bb-4bee-888c-1a24c1744bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.207757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1142/2259] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:49.222391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eacdc-370c-49af-b167-e7694247f0b6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.224726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a35eacdc-370c-49af-b167-e7694247f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.383198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eacdc-370c-49af-b167-e7694247f0b6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.387548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377d60a-0ed8-4e41-baa5-265c436cd8be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.388439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377d60a-0ed8-4e41-baa5-265c436cd8be service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.388669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377d60a-0ed8-4e41-baa5-265c436cd8be service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.389307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377d60a-0ed8-4e41-baa5-265c436cd8be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.411771 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377d60a-0ed8-4e41-baa5-265c436cd8be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.413422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377d60a-0ed8-4e41-baa5-265c436cd8be service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.444228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1118/2260] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:49.543782 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99015bc-14cd-49c9-92f3-73fcf338272e None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.544342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99015bc-14cd-49c9-92f3-73fcf338272e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.544817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99015bc-14cd-49c9-92f3-73fcf338272e None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.546749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1143/2261] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:25:49.552527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b414-2961-4a17-8711-3e26f8454bc3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.552977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b414-2961-4a17-8711-3e26f8454bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.553879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b414-2961-4a17-8711-3e26f8454bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.593222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b465b414-2961-4a17-8711-3e26f8454bc3 None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:49.594664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b465b414-2961-4a17-8711-3e26f8454bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.663266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1119/2262] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:49.677017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99015bc-14cd-49c9-92f3-73fcf338272e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.679483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e99015bc-14cd-49c9-92f3-73fcf338272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.693749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99015bc-14cd-49c9-92f3-73fcf338272e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.697990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e93fb-3aca-49d2-9723-c37d70bdb52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.698594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e93fb-3aca-49d2-9723-c37d70bdb52c service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.698869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e93fb-3aca-49d2-9723-c37d70bdb52c service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.699561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e93fb-3aca-49d2-9723-c37d70bdb52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.708973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e93fb-3aca-49d2-9723-c37d70bdb52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.710453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e93fb-3aca-49d2-9723-c37d70bdb52c service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:49.719548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1144/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:49.829905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385dad2-3f86-4720-8d86-c7d485d5b4ee None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.830228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385dad2-3f86-4720-8d86-c7d485d5b4ee None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.830506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385dad2-3f86-4720-8d86-c7d485d5b4ee None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.832107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1120/2264] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:25:49.841358 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25e73-94f4-4f5a-a9c8-facc99d22d9c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.842133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25e73-94f4-4f5a-a9c8-facc99d22d9c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.842480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25e73-94f4-4f5a-a9c8-facc99d22d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.890145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5cf25e73-94f4-4f5a-a9c8-facc99d22d9c None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:49.891605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5cf25e73-94f4-4f5a-a9c8-facc99d22d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:49.905145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1145/2265] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:49.916489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385dad2-3f86-4720-8d86-c7d485d5b4ee None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:49.932854 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385dad2-3f86-4720-8d86-c7d485d5b4ee None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:49.964027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:49.966649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:49.967118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:49.967814 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:49.990431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:49.992595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:50.017889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1121/2266] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:50.275223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a062b-1520-4a22-a0f4-692e7d8ad443 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.275710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a062b-1520-4a22-a0f4-692e7d8ad443 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.275793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a062b-1520-4a22-a0f4-692e7d8ad443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.316463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-567a062b-1520-4a22-a0f4-692e7d8ad443 None None] MFA Rules not processed for user `ade26dfd3de74c5d9549654155a0b995`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:50.317917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-567a062b-1520-4a22-a0f4-692e7d8ad443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:50.366683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:50.420280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1146/2267] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:50.430400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:50.440446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5519b-6a90-45f8-ba45-28d43fe4e287 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:50.444258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:50.444886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.445162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.445426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.524933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:50.524933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:50.532899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1122/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:25:50.742145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48c1b-857d-4623-a127-9d0f895d7524 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.742430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48c1b-857d-4623-a127-9d0f895d7524 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.742732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48c1b-857d-4623-a127-9d0f895d7524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.764968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-94b48c1b-857d-4623-a127-9d0f895d7524 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:50.766853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-94b48c1b-857d-4623-a127-9d0f895d7524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:50.827085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1147/2269] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:25:50.840383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:50.841847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:50.887823 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:50.929599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b04cf-ab05-44c9-9601-cad3bc932ecc service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:50.939392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:50.940025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:50.940304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:50.940724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:50.952055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:50.954238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:50.963707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1123/2270] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:25:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:25:55.926303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea3f12-e49a-4bef-8be6-437a710d4537 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:55.926936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea3f12-e49a-4bef-8be6-437a710d4537 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:55.927366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea3f12-e49a-4bef-8be6-437a710d4537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:55.985283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-48ea3f12-e49a-4bef-8be6-437a710d4537 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:55.986979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48ea3f12-e49a-4bef-8be6-437a710d4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:56.011554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1148/2271] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:56.076639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:56.096717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e48d2b-ce1c-409f-8888-b5604b411960 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:56.108220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:56.110037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.110419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.110790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.120856 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:56.123922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:56.139262 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1124/2272] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:25:56.927416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6df0b-f9cf-48d3-a0a1-56dc753d726b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:56.928256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6df0b-f9cf-48d3-a0a1-56dc753d726b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:56.928675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6df0b-f9cf-48d3-a0a1-56dc753d726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:56.972540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-90f6df0b-f9cf-48d3-a0a1-56dc753d726b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:25:56.975969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-90f6df0b-f9cf-48d3-a0a1-56dc753d726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:57.079957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1149/2273] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:25:57.104462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:25:57.107047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:25:57.185536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901678b5-89b4-4090-90b1-8211a10a5c5a service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:25:57.205570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:25:57.206199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:25:57.206483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:25:57.206751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:25:57.236463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:25:57.241829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:25:57.280322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1125/2274] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:01.823027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232942-6cc2-4010-884f-e756b8221a3c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:01.823603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232942-6cc2-4010-884f-e756b8221a3c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:01.823603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232942-6cc2-4010-884f-e756b8221a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:01.847337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d9232942-6cc2-4010-884f-e756b8221a3c None None] MFA Rules not processed for user `409a8ac347df45a298301b6aa773e34f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:01.848843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d9232942-6cc2-4010-884f-e756b8221a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:01.855769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1150/2275] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:07.260655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=30 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:11.839751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=73 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:11.841103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:11.843069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:11.939526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d445-1830-44c3-b9d8-c68f0415fd9f service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:11.947425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:11.948047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:11.948325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:11.948874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:11.951224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:11.963495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:11.965279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:11.980363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1126/2276] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:13.643315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83b8c6-bd1e-4313-a0cd-5b566c49945c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:13.643852 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83b8c6-bd1e-4313-a0cd-5b566c49945c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:13.643954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83b8c6-bd1e-4313-a0cd-5b566c49945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:13.666266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-af83b8c6-bd1e-4313-a0cd-5b566c49945c None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:13.668321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-af83b8c6-bd1e-4313-a0cd-5b566c49945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:13.689815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1151/2277] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:26:13.713840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:13.728599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0179eb-a42a-490c-b8d3-dd47047b60d7 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:13.734848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:13.735828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:13.736107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:13.736372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:13.752973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:13.755310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:13.765632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1127/2278] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:16.751240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7764c-a41d-4728-b3dd-e28fe92ff5dc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:16.751875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7764c-a41d-4728-b3dd-e28fe92ff5dc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:16.751875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7764c-a41d-4728-b3dd-e28fe92ff5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:16.773034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-50f7764c-a41d-4728-b3dd-e28fe92ff5dc None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:16.776636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-50f7764c-a41d-4728-b3dd-e28fe92ff5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:16.787164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1152/2279] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:16.813044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:16.825559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c3e6b-9a8d-4045-953c-556740baf554 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:16.832533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:16.833216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:16.833522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:16.833815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:16.843042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:16.845576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:16.856342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1128/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:19.445063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e37bb8-24f8-4019-a616-f32a6a8bbd45 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:19.445673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e37bb8-24f8-4019-a616-f32a6a8bbd45 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:19.445673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e37bb8-24f8-4019-a616-f32a6a8bbd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:19.477282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b0e37bb8-24f8-4019-a616-f32a6a8bbd45 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:19.481079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b0e37bb8-24f8-4019-a616-f32a6a8bbd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:19.503084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1153/2281] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:19.517047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:19.532730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae38c6-0323-4f34-8c57-d6ad6c87ff06 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:19.541564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:19.542925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:19.543554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:19.544146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:19.559347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:19.561364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:19.581748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1129/2282] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:26:20.990648 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f18c5-b76c-4f30-aa3a-8b74788dee87 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:20.991306 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f18c5-b76c-4f30-aa3a-8b74788dee87 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:20.991549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f18c5-b76c-4f30-aa3a-8b74788dee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:21.012464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-054f18c5-b76c-4f30-aa3a-8b74788dee87 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:21.013870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-054f18c5-b76c-4f30-aa3a-8b74788dee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:21.022795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1154/2283] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:26:21.051549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:21.064688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1b978-d1f6-4a42-8c3d-11dca977b6b8 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:21.081615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:21.082243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:21.082766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:21.083041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:21.091969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:21.093570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:21.108164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1130/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:31.014165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=12 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:31.022320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2b12f-8e91-4a29-a3cb-a43df28fb9a3 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:31.023004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2b12f-8e91-4a29-a3cb-a43df28fb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:31.023459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2b12f-8e91-4a29-a3cb-a43df28fb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:31.049820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-52e2b12f-8e91-4a29-a3cb-a43df28fb9a3 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:31.051398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-52e2b12f-8e91-4a29-a3cb-a43df28fb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:31.059018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1155/2285] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 28 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:31.089860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:31.103193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ff0f-25c9-43fd-94a7-263f3d739446 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:31.108349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:31.109059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:31.110047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:31.110352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:31.119135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:31.120722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:31.130840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1131/2286] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:26:33.484213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9620-836d-469c-81e8-f194b5a50360 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:33.484817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9620-836d-469c-81e8-f194b5a50360 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:33.484817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9620-836d-469c-81e8-f194b5a50360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:33.504128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6a3b9620-836d-469c-81e8-f194b5a50360 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:33.505354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6a3b9620-836d-469c-81e8-f194b5a50360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:33.513987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1156/2287] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 28 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:33.529166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:33.541610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13017c-8ee8-4cbd-8e7d-43b80bd95369 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:33.547054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:33.547649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:33.547931 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:33.548238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:33.556768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:33.558351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:33.568146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1132/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:43.498786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:43.564019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=68 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:43.970113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95005cb-06c8-4cfb-b2dc-90d8a41771cf None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:43.970398 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95005cb-06c8-4cfb-b2dc-90d8a41771cf None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:43.970667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95005cb-06c8-4cfb-b2dc-90d8a41771cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:43.991157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c95005cb-06c8-4cfb-b2dc-90d8a41771cf None None] MFA Rules not processed for user `6ebfeba30aa342a99e0d5855f9ac8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:26:43.992343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c95005cb-06c8-4cfb-b2dc-90d8a41771cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:26:44.052224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1157/2289] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:26:48.410493 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:26:48.423377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07d5c2-1db9-4c71-be08-1fab764ccc7a service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:26:48.428105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:26:48.429049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:26:48.429497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:26:48.429775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:26:48.443758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:26:48.444965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:26:48.457101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1133/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:26:54.044757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=25 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:58.450836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:00.321549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:27:00.322058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:27:00.322258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:27:00.344507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] MFA Rules not processed for user `778f3756020548dda6e0162f5560a328`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:27:00.345814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:27:00.405835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1158/2291] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:27:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:27:06.844106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:27:06.846371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:27:06.861204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376319e5-ce7e-4b06-b1ae-118b764e6d29 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:27:06.865946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:27:06.866630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:27:06.867010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:27:06.867336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] PATH_INFO: `/v3/users/51bb880d57474b658f1cf85353c00743` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:27:06.868484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bb880d57474b658f1cf85353c00743)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:27:06.870415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:27:06.919480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bb880d57474b658f1cf85353c00743'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:06.926806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bb880d57474b658f1cf85353c00743'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:06.927461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bb880d57474b658f1cf85353c00743'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:06.928073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bb880d57474b658f1cf85353c00743'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:06.935492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed131e61-d85c-41f4-a396-ef6d924417c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bb880d57474b658f1cf85353c00743'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:06.953520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1134/2292] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:27:06 2022] DELETE /identity/v3/users/51bb880d57474b658f1cf85353c00743 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:27:07.349302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:27:07.360184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94202e88-be18-4563-8b72-5778d5fff293 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:27:07.422328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:27:07.423100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:27:07.423377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:27:07.423652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] PATH_INFO: `/v3/projects/b248cec406c24aee8df4f63a24a5a6ba` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:27:07.424752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b248cec406c24aee8df4f63a24a5a6ba)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:27:07.426667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:27:07.471909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b248cec406c24aee8df4f63a24a5a6ba', 'request_id': 'req-768b738a-a50a-4344-b3dd-49be4a1f1c24'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:07.477818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b248cec406c24aee8df4f63a24a5a6ba', 'request_id': 'req-768b738a-a50a-4344-b3dd-49be4a1f1c24'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:07.483353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b248cec406c24aee8df4f63a24a5a6ba', 'request_id': 'req-768b738a-a50a-4344-b3dd-49be4a1f1c24'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:07.495205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] The token cache is being invalidate because project b248cec406c24aee8df4f63a24a5a6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:27:07.495489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:07.496098 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-768b738a-a50a-4344-b3dd-49be4a1f1c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:27:07.497606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1159/2293] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:27:07 2022] DELETE /identity/v3/projects/b248cec406c24aee8df4f63a24a5a6ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:27:16.950004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:17.492216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:25.901784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:27:25.902299 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:27:25.902462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:27:25.928801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] MFA Rules not processed for user `0c34731e291046cbb634305a95ead7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:27:25.930113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:27:26.001264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1135/2294] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:27:27.467518 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:27:27.468124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:27:27.468245 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:27:27.490421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] MFA Rules not processed for user `8efaf0eb944e4f0bac9a77bca9b68e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:27:27.491654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:27:27.553560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1160/2295] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:27:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:27:35.994382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=25 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:37.546235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=25 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:03.236888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:03.238341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:03.293377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b1717-e818-4605-ac0e-c4a42360acb5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:03.296949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:03.297546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:03.297822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:03.298089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:03.300689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:03.359309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:03.360740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:03.370791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1136/2296] 10.222.0.27 () {60 vars in 1396 bytes} [Wed Sep 28 12:28:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3268 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:04.331443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:04.341470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5310dd-a779-43e0-976d-06bfc344e480 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:04.345118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:04.346533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:04.346814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:04.347083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:04.348896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:04.426471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:04.427835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d8cea-a7dc-4f3e-bbfb-bc6efa6caffc service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:04.439185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1161/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:04.598968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:04.600939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:04.615833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9c50-d59d-4970-9c98-5b521ca96c89 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:04.637469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:04.640061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:04.640484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:04.640892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:04.646111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:04.666661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:04.668148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f48b8-37c0-402f-8fb1-91a2ba6978e8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:04.683979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1137/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:04.942087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d6cea-4383-4d23-9339-91ffd32f2697 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:04.942749 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d6cea-4383-4d23-9339-91ffd32f2697 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:04.943139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d6cea-4383-4d23-9339-91ffd32f2697 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:04.944767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1162/2299] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:28:04.951670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b1b65-c868-4d5c-8e1f-27099a9c4908 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:04.951997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b1b65-c868-4d5c-8e1f-27099a9c4908 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:04.952251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b1b65-c868-4d5c-8e1f-27099a9c4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:04.974560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7b1b1b65-c868-4d5c-8e1f-27099a9c4908 None None] MFA Rules not processed for user `31cab6d1bf8e41c49643a3f80c7703f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:04.976022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7b1b1b65-c868-4d5c-8e1f-27099a9c4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:04.983390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1138/2300] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:04.996033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d6cea-4383-4d23-9339-91ffd32f2697 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:05.007946 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d6cea-4383-4d23-9339-91ffd32f2697 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:05.012015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c31f02-035b-4459-90c8-0eb142ff3e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:05.016274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31f02-035b-4459-90c8-0eb142ff3e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:05.016636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31f02-035b-4459-90c8-0eb142ff3e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:05.017016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31f02-035b-4459-90c8-0eb142ff3e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:05.026508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c31f02-035b-4459-90c8-0eb142ff3e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:05.028101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c31f02-035b-4459-90c8-0eb142ff3e78 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:05.037155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1163/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:05.149182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa038ad-1e78-4492-9a20-fa86251c904a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:05.149534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa038ad-1e78-4492-9a20-fa86251c904a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:05.149733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa038ad-1e78-4492-9a20-fa86251c904a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:05.151666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1139/2302] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:28:05.157228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:05.157578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:05.158028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:05.179150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:05.180857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:05.195037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1164/2303] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:28:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:28:05.207554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa038ad-1e78-4492-9a20-fa86251c904a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:05.219216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa038ad-1e78-4492-9a20-fa86251c904a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:05.223091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c029b2-c48d-40c9-b35d-6e1529a0ae37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:05.223687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c029b2-c48d-40c9-b35d-6e1529a0ae37 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:05.223962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c029b2-c48d-40c9-b35d-6e1529a0ae37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:05.224230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c029b2-c48d-40c9-b35d-6e1529a0ae37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:05.234879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c029b2-c48d-40c9-b35d-6e1529a0ae37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:05.236557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c029b2-c48d-40c9-b35d-6e1529a0ae37 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:05.247408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1140/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:05.823280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:05.835495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db468f-667c-4f1d-99f1-16406de478d6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:05.841695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:05.842388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:05.842736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:05.843077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:05.846090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:05.936899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:05.938706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:05.968842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1165/2305] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:28:08.430015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:08.431440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:08.431888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:08.453730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] MFA Rules not processed for user `6ebfeba30aa342a99e0d5855f9ac8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:08.455825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:08.526193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1141/2306] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:08.873243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:08.888708 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3fc68-d517-451d-b5fb-2e9784f2535e service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:08.894356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:08.895220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:08.895684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:08.895888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:08.898068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:08.911959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:08.914285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:08.924670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1166/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:09.294702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:09.296143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:09.337282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:09.395020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066647c-ddc9-493a-9e6a-0f62cddefaaf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:09.400446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:09.401195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:09.401544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:09.401907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:09.406196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:09.417745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:09.419374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:09.430747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1142/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:10.392101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:10.394626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:10.418459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec434-767a-4271-a69a-0d38d943e831 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:10.424489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:10.428815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:10.428815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:10.428815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:10.429397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:10.445454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:10.447413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:10.473119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1167/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:10.489789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:10.491303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:10.512258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031a40-4f78-4e0b-ad39-0c5fd6714cf5 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:10.518099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:10.519017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:10.519536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:10.519874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] PATH_INFO: `/v3/users/778f3756020548dda6e0162f5560a328` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:10.521123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778f3756020548dda6e0162f5560a328)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:10.523490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:10.575635 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778f3756020548dda6e0162f5560a328'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.582860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778f3756020548dda6e0162f5560a328'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.583548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778f3756020548dda6e0162f5560a328'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.584497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778f3756020548dda6e0162f5560a328'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.591882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c67e40f9-3746-4a2c-a063-83245ca64a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778f3756020548dda6e0162f5560a328'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.609970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1143/2310] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:10 2022] DELETE /identity/v3/users/778f3756020548dda6e0162f5560a328 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:10.788186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:10.811090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c57e-c4ec-44df-bbeb-5c839afe44ae service placement] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:10.853640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:10.887705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:10.888338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:10.888820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:10.889215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] PATH_INFO: `/v3/projects/64b15185b3aa444eaf71b04c372b7e71` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:10.890343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b15185b3aa444eaf71b04c372b7e71)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:10.892419 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:10.947826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b15185b3aa444eaf71b04c372b7e71', 'request_id': 'req-98de56e9-1efc-4a86-970a-9c826e953b43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.955831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b15185b3aa444eaf71b04c372b7e71', 'request_id': 'req-98de56e9-1efc-4a86-970a-9c826e953b43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.965439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b15185b3aa444eaf71b04c372b7e71', 'request_id': 'req-98de56e9-1efc-4a86-970a-9c826e953b43'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.979492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] The token cache is being invalidate because project 64b15185b3aa444eaf71b04c372b7e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:10.979943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.980860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-98de56e9-1efc-4a86-970a-9c826e953b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:10.982789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1168/2311] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:10 2022] DELETE /identity/v3/projects/64b15185b3aa444eaf71b04c372b7e71 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:10.989175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:10.989491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:10.989809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.017975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:11.019752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:11.081034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1144/2312] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:11.088544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.088855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.089126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.109283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:11.110410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:11.120562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1169/2313] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:11.129949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.140069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de62f0-f7c5-4c5e-b563-7103618fb90a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.145283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.145898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.146176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.146445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.147716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:28:11.147716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.149172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.163234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1145/2314] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:28:11.167601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.178410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532acc2b-f149-4de5-a4c8-b8ca295d38a2 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.183469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.184087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.184346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.184612 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.185304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.187202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.217544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1170/2315] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:11 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:11.222019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.233162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f7896-5954-4471-a935-b451ce7d9b3e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.253101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:11.317479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.318221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.318496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.318865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.319722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.321904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.349371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1146/2316] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:11 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:11.353690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.365520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6785ba2-be34-448e-8805-551b42d94912 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.370896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.371626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.372062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.372404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.373307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.374986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.388913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1171/2317] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:11.390274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.402883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f621f-37c5-49e2-8b06-8622a6404a84 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.409200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3e25d-8423-4e48-920b-c473429dfd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.409904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3e25d-8423-4e48-920b-c473429dfd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.410544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3e25d-8423-4e48-920b-c473429dfd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.410544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3e25d-8423-4e48-920b-c473429dfd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.411253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3e25d-8423-4e48-920b-c473429dfd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.413411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3e25d-8423-4e48-920b-c473429dfd51 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.428829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1147/2318] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:11.431150 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.441949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d067b-fb9a-4d61-bbab-32a2d378d701 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.446663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.447312 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.447610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.447884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] PATH_INFO: `/v3/projects/3bf960f8f4f04cb28c0e5b9398b6549c/users/90d87e9e475c4e1b8a7e9d2c3b9f7f8e/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.464131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf960f8f4f04cb28c0e5b9398b6549c, user_id=90d87e9e475c4e1b8a7e9d2c3b9f7f8e, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.466825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.480397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1172/2319] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:11 2022] PUT /identity/v3/projects/3bf960f8f4f04cb28c0e5b9398b6549c/users/90d87e9e475c4e1b8a7e9d2c3b9f7f8e/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:11.491956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.492511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.492640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.534307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] MFA Rules not processed for user `90d87e9e475c4e1b8a7e9d2c3b9f7f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:11.535904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:11.616364 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1148/2320] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:11.627656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:11.629400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:11.690813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:11.714597 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fce7e-d708-406b-b408-6fede5c0ce8a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:11.721112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159190-3379-47df-a495-9253798cf6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:11.721955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159190-3379-47df-a495-9253798cf6c8 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:11.722329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159190-3379-47df-a495-9253798cf6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:11.722698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159190-3379-47df-a495-9253798cf6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:11.731902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de159190-3379-47df-a495-9253798cf6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:11.733638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de159190-3379-47df-a495-9253798cf6c8 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:11.748679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1173/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:12.026991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:12.107910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ba97-0c75-4f88-8516-85d04cb14987 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:12.113418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:12.114050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:12.114324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:12.114592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] PATH_INFO: `/v3/users/90d87e9e475c4e1b8a7e9d2c3b9f7f8e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:12.115692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d87e9e475c4e1b8a7e9d2c3b9f7f8e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:12.117624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:12.148187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:12.172761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d87e9e475c4e1b8a7e9d2c3b9f7f8e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.185239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d87e9e475c4e1b8a7e9d2c3b9f7f8e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.186086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d87e9e475c4e1b8a7e9d2c3b9f7f8e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.186695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d87e9e475c4e1b8a7e9d2c3b9f7f8e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.195515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d87e9e475c4e1b8a7e9d2c3b9f7f8e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.217016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1149/2322] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:12 2022] DELETE /identity/v3/users/90d87e9e475c4e1b8a7e9d2c3b9f7f8e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:12.221766 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:12.222054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:12.222327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:12.243584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:12.244877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:12.309133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1174/2323] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:12.319047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:12.320477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:12.382922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf02f8-7da0-445c-8e85-0fe4811a6a8c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:12.388319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:12.389608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:12.389892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:12.390164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:12.401511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:12.402857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:12.413031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1150/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:12.621230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:12.623923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:12.703417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ad53f-537c-43a0-b2f0-5cf6df6248eb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:12.710758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:12.711443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:12.711954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:12.712293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:12.714459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:12.780042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:12.781658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e232cef-7b2e-4222-886a-4f2794d2ce88 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:12.790704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1175/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:12.861029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:12.863012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:12.886867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3d497-d937-4cb3-8e48-c62ebd47365a service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:12.893202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:12.894133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:12.894409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:12.894840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] PATH_INFO: `/v3/projects/3bf960f8f4f04cb28c0e5b9398b6549c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:12.896257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf960f8f4f04cb28c0e5b9398b6549c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:12.898282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:12.952503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf960f8f4f04cb28c0e5b9398b6549c', 'request_id': 'req-5b000297-81ab-44fc-b0af-a8d0111bdc6a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.960345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf960f8f4f04cb28c0e5b9398b6549c', 'request_id': 'req-5b000297-81ab-44fc-b0af-a8d0111bdc6a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.966974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf960f8f4f04cb28c0e5b9398b6549c', 'request_id': 'req-5b000297-81ab-44fc-b0af-a8d0111bdc6a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.980710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] The token cache is being invalidate because project 3bf960f8f4f04cb28c0e5b9398b6549c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:12.981043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.981686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5b000297-81ab-44fc-b0af-a8d0111bdc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:12.983152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1151/2326] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:12 2022] DELETE /identity/v3/projects/3bf960f8f4f04cb28c0e5b9398b6549c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:12.988930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:12.989217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:12.989488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.009962 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:13.011156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:13.028730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:13.071483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1176/2327] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:13.079716 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.079996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.080264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.100454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:13.101660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:13.109653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1152/2328] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:13.114464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.124087 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa307b3-f907-45e3-9303-d4cbaf45100f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.129469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.130061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.130336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.130608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.131263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:28:13.131556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.133185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.144853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1177/2329] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:28:13.149193 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.159962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec3c96-19a2-4008-b3e3-f890f827add2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.167842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.168867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.169325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.169760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.170416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.172689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.195774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:13.209064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1153/2330] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:13.210267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.220755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048892c0-4233-4c16-beaa-b7f954dc3d89 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.278603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.279209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.279490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.279760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.280388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.282903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.306189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1178/2331] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:13.310367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.321001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006d831-6659-4098-b0db-d4b27f67e4b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.325924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.326579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.326855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.327118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.327773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.329469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.343168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1154/2332] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:13.344379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.355348 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5307f-0463-4736-b5bb-f00865071984 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.360109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f90f4d-9eb6-4127-847d-1c575f28011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.361952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f90f4d-9eb6-4127-847d-1c575f28011b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.362231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f90f4d-9eb6-4127-847d-1c575f28011b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.362499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f90f4d-9eb6-4127-847d-1c575f28011b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.363139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f90f4d-9eb6-4127-847d-1c575f28011b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.364733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f90f4d-9eb6-4127-847d-1c575f28011b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.375668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1179/2333] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:13.379995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.389675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca0a5a-cff3-4c4c-9526-ef801c50351a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.394653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.395298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.395571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.395839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] PATH_INFO: `/v3/projects/0a62f235e038467186db1bae312ee7bf/users/0d8514ac9d4c423ca59fe153d808fba7/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.411921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a62f235e038467186db1bae312ee7bf, user_id=0d8514ac9d4c423ca59fe153d808fba7, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.414618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.428836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1155/2334] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:13 2022] PUT /identity/v3/projects/0a62f235e038467186db1bae312ee7bf/users/0d8514ac9d4c423ca59fe153d808fba7/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:13.439409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.439692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.439960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.469633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] MFA Rules not processed for user `0d8514ac9d4c423ca59fe153d808fba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:13.471288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:13.534204 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1180/2335] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:28:13.538731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.599660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49820d-ad81-4d7a-9416-44fb73e1e1cf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.604294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.604928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.605208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.605478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.606108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.607976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.635158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1156/2336] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:13.639200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.650633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9222a-ec8d-4f69-9951-77e3f100ee48 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.663416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:13.707887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.708489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.708764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.709062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.709702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.711635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.733038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1181/2337] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:13.737908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.748722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f3659-e3a7-4ea9-b3b1-ba1fd065d4c5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.753892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.754524 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.754808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.755073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.755713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.757316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.768646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1157/2338] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:13.773063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.784128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743e850-c0b4-405d-95f1-3e3736e8011f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.789200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.789933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.790268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.790600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] PATH_INFO: `/v3/projects/4ee4ffae9d9a412e885ae32a9d732f8d/users/0a0a44875a4848dda56c731f1a01406d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.808584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee4ffae9d9a412e885ae32a9d732f8d, user_id=0a0a44875a4848dda56c731f1a01406d, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.811020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.826543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1182/2339] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:13 2022] PUT /identity/v3/projects/4ee4ffae9d9a412e885ae32a9d732f8d/users/0a0a44875a4848dda56c731f1a01406d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:13.831185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.843308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201b1dc-ee1d-490f-af39-b82a434cdc58 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.906303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb921cad-9bb0-467b-ad15-7804fb575112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.906923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921cad-9bb0-467b-ad15-7804fb575112 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.907189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921cad-9bb0-467b-ad15-7804fb575112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.907652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb921cad-9bb0-467b-ad15-7804fb575112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.908280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb921cad-9bb0-467b-ad15-7804fb575112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.909880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb921cad-9bb0-467b-ad15-7804fb575112 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.919911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1158/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:13.924085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:13.937789 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42349dcd-396f-450b-b251-51abe97e8bca admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:13.946017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:13.946671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.946944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.947209 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] PATH_INFO: `/v3/projects/4ee4ffae9d9a412e885ae32a9d732f8d/users/0a0a44875a4848dda56c731f1a01406d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:13.949377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee4ffae9d9a412e885ae32a9d732f8d, user_id=0a0a44875a4848dda56c731f1a01406d, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:13.951992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:13.965280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1183/2341] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:13 2022] PUT /identity/v3/projects/4ee4ffae9d9a412e885ae32a9d732f8d/users/0a0a44875a4848dda56c731f1a01406d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:13.978848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:13.979136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:13.979544 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:14.013723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] MFA Rules not processed for user `0a0a44875a4848dda56c731f1a01406d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:14.015450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:14.062191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:14.133550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1159/2342] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:14.148099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:14.151252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:14.235319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6c60e-375d-423d-9f8f-860efff6efc0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:14.239530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:14.240230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:14.240508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:14.240804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:14.252980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:14.255177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:14.265551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1184/2343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:14.352029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:14.362902 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c3404-bae5-4b61-838d-a6128908a219 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:14.368744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:14.369391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:14.369669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:14.369940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:14.440586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:14.442086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:14.452233 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1160/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:20.178843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:20.180938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:20.234838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:20.237603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:20.276745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0749cc8-3b4f-461d-90f1-79994f007824 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:20.284503 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:20.285323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:20.285667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:20.286152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:20.288273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:20.303093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:20.304764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:20.317903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1185/2345] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:20.335868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af3f32-8bc6-4598-acc4-e10ac08ed2bf service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:20.339531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854202-a692-412b-afed-8f915300c09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:20.340143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854202-a692-412b-afed-8f915300c09f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:20.340420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854202-a692-412b-afed-8f915300c09f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:20.340690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854202-a692-412b-afed-8f915300c09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:20.353975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57854202-a692-412b-afed-8f915300c09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:20.355428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57854202-a692-412b-afed-8f915300c09f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:20.364941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1161/2346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:23.926418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:23.927904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:23.947097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:24.005231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77338d9-ebef-4d93-a2a0-bcd87f8d48af service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:24.010683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:24.011675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:24.011675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:24.011908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:24.014111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:24.076599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:24.079987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:24.089638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1186/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:28.297740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854202-a692-412b-afed-8f915300c09f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:28.299331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57854202-a692-412b-afed-8f915300c09f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:28.317345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854202-a692-412b-afed-8f915300c09f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:28.322983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:28.323844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:28.324120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:28.324389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:28.326147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:28.339006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:28.340621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e542-9b3d-4564-8f0a-4ed619dc78d0 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:28.352281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1162/2348] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:28.427133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:28.438850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6b21-904e-4d30-a971-7664db4a0685 service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:28.444507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:28.445128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:28.445406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:28.445675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:28.447395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:28.509514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:28.511215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:28.522045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1187/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:29.310984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:29.311405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:29.311520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:29.331554 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:29.332723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:29.377043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:29.388223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1163/2350] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 28 12:28:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:29.433877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:29.435264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:29.485838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:29.504282 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b395a-b4a0-4475-a3a6-ff5fb37b87eb service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:29.509405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:29.510016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:29.510292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:29.510561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:29.518919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:29.520486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:29.528653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1188/2351] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:28:36.844633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:36.846316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:36.928830 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d85726-7cf6-4e91-98bc-49014216b491 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:36.934690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:36.935427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:36.935696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:36.935963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] PATH_INFO: `/v3/users/409a8ac347df45a298301b6aa773e34f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:36.937203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409a8ac347df45a298301b6aa773e34f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:36.939713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:37.003444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409a8ac347df45a298301b6aa773e34f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.010779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409a8ac347df45a298301b6aa773e34f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.011480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409a8ac347df45a298301b6aa773e34f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.012186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409a8ac347df45a298301b6aa773e34f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.021160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409a8ac347df45a298301b6aa773e34f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.050792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1164/2352] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:36 2022] DELETE /identity/v3/users/409a8ac347df45a298301b6aa773e34f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:37.253210 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:37.267108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22010cf8-c584-41eb-8bbc-0aab9b2bb9ed service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:37.325859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:37.326478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:37.326745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:37.327010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] PATH_INFO: `/v3/projects/44a86af4bfaa4136a85e853caea8fbd7` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:37.328325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a86af4bfaa4136a85e853caea8fbd7)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:37.330430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:37.375592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a86af4bfaa4136a85e853caea8fbd7', 'request_id': 'req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.381523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a86af4bfaa4136a85e853caea8fbd7', 'request_id': 'req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.386947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a86af4bfaa4136a85e853caea8fbd7', 'request_id': 'req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.398991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] The token cache is being invalidate because project 44a86af4bfaa4136a85e853caea8fbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:37.399271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.399879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.401376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1189/2353] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:37 2022] DELETE /identity/v3/projects/44a86af4bfaa4136a85e853caea8fbd7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:37.405498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:37.407642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:37.420698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7d82-a7be-4801-a6e8-025534341719 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:37.481076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:37.481705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:37.481979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:37.482416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] PATH_INFO: `/v3/users/ade26dfd3de74c5d9549654155a0b995` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:37.483548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade26dfd3de74c5d9549654155a0b995)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:37.486335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:37.500153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:37.538741 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade26dfd3de74c5d9549654155a0b995'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.545904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade26dfd3de74c5d9549654155a0b995'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.546603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade26dfd3de74c5d9549654155a0b995'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.547461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade26dfd3de74c5d9549654155a0b995'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.554623 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade26dfd3de74c5d9549654155a0b995'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.576594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1165/2354] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:37 2022] DELETE /identity/v3/users/ade26dfd3de74c5d9549654155a0b995 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:37.769969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:37.771679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:37.787545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3ea6-fa45-429a-9ffc-d161de5e7104 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:37.857725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:37.858350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:37.858629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:37.858901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] PATH_INFO: `/v3/projects/687ee3427a3b47ad940ba28947d79131` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:37.860154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687ee3427a3b47ad940ba28947d79131)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:37.862146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:37.873221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:37.909892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687ee3427a3b47ad940ba28947d79131', 'request_id': 'req-e975727c-9b7a-4575-8647-ec688d4e5ec2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.916613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687ee3427a3b47ad940ba28947d79131', 'request_id': 'req-e975727c-9b7a-4575-8647-ec688d4e5ec2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.922479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687ee3427a3b47ad940ba28947d79131', 'request_id': 'req-e975727c-9b7a-4575-8647-ec688d4e5ec2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.935349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] The token cache is being invalidate because project 687ee3427a3b47ad940ba28947d79131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:37.935643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.936351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e975727c-9b7a-4575-8647-ec688d4e5ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:37.939036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1190/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:37 2022] DELETE /identity/v3/projects/687ee3427a3b47ad940ba28947d79131 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:44.674466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:44.675894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:44.689679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6a93e-b315-4cb4-af0f-01178d20b372 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:44.748105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:44.748735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:44.749043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:44.749855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] PATH_INFO: `/v3/users/0d8514ac9d4c423ca59fe153d808fba7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:44.751094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8514ac9d4c423ca59fe153d808fba7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:44.753083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:44.805998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8514ac9d4c423ca59fe153d808fba7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:44.814041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8514ac9d4c423ca59fe153d808fba7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:44.814882 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8514ac9d4c423ca59fe153d808fba7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:44.815305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8514ac9d4c423ca59fe153d808fba7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:44.829196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8514ac9d4c423ca59fe153d808fba7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:44.856344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1166/2356] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:44 2022] DELETE /identity/v3/users/0d8514ac9d4c423ca59fe153d808fba7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:44.857432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:44.857887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:44.858092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:44.881336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:44.882617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:44.942620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1191/2357] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:44.953425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:44.954878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:44.969576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:45.018012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1bfa4-4a5d-4c7a-86ee-1628de5bef54 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:45.021657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:45.022255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:45.022526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:45.022789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:45.032938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:45.034345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:45.043954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1167/2358] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:45.326365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:45.327454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:45.342736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f15ba-15ae-4558-b35e-a79d1ad3373f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:45.348484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:45.349415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:45.349743 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:45.350007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] PATH_INFO: `/v3/projects/0a62f235e038467186db1bae312ee7bf` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:45.351129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a62f235e038467186db1bae312ee7bf)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:45.355642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:45.415726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a62f235e038467186db1bae312ee7bf', 'request_id': 'req-9e7963e3-3d69-44fe-b3d3-7f0578d57262'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.424050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a62f235e038467186db1bae312ee7bf', 'request_id': 'req-9e7963e3-3d69-44fe-b3d3-7f0578d57262'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.431079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a62f235e038467186db1bae312ee7bf', 'request_id': 'req-9e7963e3-3d69-44fe-b3d3-7f0578d57262'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.449945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] The token cache is being invalidate because project 0a62f235e038467186db1bae312ee7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:45.450524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.451163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-9e7963e3-3d69-44fe-b3d3-7f0578d57262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.452838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1192/2359] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:45 2022] DELETE /identity/v3/projects/0a62f235e038467186db1bae312ee7bf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:45.457688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:45.489039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7da31-a7c9-48bf-adc1-ea19905dd7f9 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:45.556755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:45.557656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:45.557656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:45.557971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] PATH_INFO: `/v3/users/0a0a44875a4848dda56c731f1a01406d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:45.559248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0a44875a4848dda56c731f1a01406d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:45.561231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:45.612137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0a44875a4848dda56c731f1a01406d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.619884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0a44875a4848dda56c731f1a01406d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.620627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0a44875a4848dda56c731f1a01406d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.621434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0a44875a4848dda56c731f1a01406d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.628293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0a44875a4848dda56c731f1a01406d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:45.646429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1168/2360] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:45 2022] DELETE /identity/v3/users/0a0a44875a4848dda56c731f1a01406d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:45.902744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:45.903215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:45.903293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:45.927062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:45.928654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:45.947137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:45.949890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:45.970907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:45.994812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:46.024605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1193/2361] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:28:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:46.038263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d880-51a0-4aae-8929-c341d0872f19 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.039442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.040910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:46.043787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.044837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.045132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.045406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] PATH_INFO: `/v3/projects/4ee4ffae9d9a412e885ae32a9d732f8d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.046745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee4ffae9d9a412e885ae32a9d732f8d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.049667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.108657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee4ffae9d9a412e885ae32a9d732f8d', 'request_id': 'req-9f428815-e95b-46b4-a024-90e6d7bece87'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:46.118006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee4ffae9d9a412e885ae32a9d732f8d', 'request_id': 'req-9f428815-e95b-46b4-a024-90e6d7bece87'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:46.127302 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42773a6-5535-4018-8eba-1263b1cc5790 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.127487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee4ffae9d9a412e885ae32a9d732f8d', 'request_id': 'req-9f428815-e95b-46b4-a024-90e6d7bece87'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:46.139162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] The token cache is being invalidate because project 4ee4ffae9d9a412e885ae32a9d732f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:46.139461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:46.140677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:46.142433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1169/2362] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:45 2022] DELETE /identity/v3/projects/4ee4ffae9d9a412e885ae32a9d732f8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:46.148961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.151016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:46.195542 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.196154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.196435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.196705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.198793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:46.227203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428815-e95b-46b4-a024-90e6d7bece87 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.232870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.233469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.233819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.234219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.236058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:46.247960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.250174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d36797-a81e-4b4d-9bf1-f8c641486234 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.256864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.258443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409f027-cfa9-4628-9510-f5dd60c605fb service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.260866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1170/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:46.262342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.262626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.263455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.267461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1194/2364] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:28:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:28:46.287444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:46.288624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:46.352951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:46.373915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1171/2365] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:46.382823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.383103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.383371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.410685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:46.411892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:46.420191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1195/2366] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:28:46.424760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.434834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9ddf-8e23-42fe-8fa5-112c7f5d93fe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.444006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.444006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.444006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.444006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.444754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:28:46.444754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.444974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.458545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1172/2367] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:28:46.463014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.473101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d2ec-ef12-485b-a402-bfe8af5ad337 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.478276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.479061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.479339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.479683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.480468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.482508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.488065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:46.529002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1196/2368] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:46 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:28:46.530163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.549565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d657e0a-badf-454b-b43e-7138b763dd31 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.670836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.685621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.686068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.686404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.688041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.690234 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.736108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1173/2369] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:46 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:28:46.739921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.753734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd434-78ca-4bf4-a590-64777bc4978e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.758821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.759431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.759712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.759978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.760642 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.762277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.786534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1197/2370] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:46.788090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.811077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98e03-6430-4575-8368-1db4da189a0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.817101 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d60cb7-e432-45fa-bbdd-7ce0e3137bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.817730 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d60cb7-e432-45fa-bbdd-7ce0e3137bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.817988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d60cb7-e432-45fa-bbdd-7ce0e3137bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.818255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d60cb7-e432-45fa-bbdd-7ce0e3137bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.818900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d60cb7-e432-45fa-bbdd-7ce0e3137bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.820475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d60cb7-e432-45fa-bbdd-7ce0e3137bd4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.835219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1174/2371] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:28:46.839002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:46.850683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead241-a8f2-4abe-81a2-fad05e39c7b4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:46.856567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:46.857483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.858334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.859404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] PATH_INFO: `/v3/projects/e76121813b894b0a9d11fe3939a21731/users/1c91f424f64a4c7db020cae720393a81/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.887262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76121813b894b0a9d11fe3939a21731, user_id=1c91f424f64a4c7db020cae720393a81, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:46.890600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:46.919234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1198/2372] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:46 2022] PUT /identity/v3/projects/e76121813b894b0a9d11fe3939a21731/users/1c91f424f64a4c7db020cae720393a81/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:46.932558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:46.933201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:46.933760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:46.971945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] MFA Rules not processed for user `1c91f424f64a4c7db020cae720393a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:46.973762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:47.053820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1175/2373] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:47.058851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.139090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae24d-c93f-4159-9a15-8f39e9fbf52e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.148401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.153152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.153537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.154256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.154809 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.156893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.189632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1199/2374] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:47 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:47.196323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.208607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cde0f-db70-40f5-a637-1490193d0141 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.267549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:47.287062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.288078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.288556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.289060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.289801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.291821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.320477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1176/2375] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:47 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:47.324756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.336864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad94022-a32f-49ec-81ee-45f8129ea916 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.342176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.342889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.343258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.343604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.344318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.346636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.365181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1200/2376] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:28:47.367091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.380132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500776-68d5-4428-9204-6310c055633e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.385569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.386408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.386793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.387170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] PATH_INFO: `/v3/projects/a3f8244dfb1e4442acbaf27ba11e6cd8/users/eb480a47fa7641a3b8cb7effa2b5f455/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.409405 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f8244dfb1e4442acbaf27ba11e6cd8, user_id=eb480a47fa7641a3b8cb7effa2b5f455, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.413070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.432728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1177/2377] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:47 2022] PUT /identity/v3/projects/a3f8244dfb1e4442acbaf27ba11e6cd8/users/eb480a47fa7641a3b8cb7effa2b5f455/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:47.434009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.447197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89264a-7487-4e7f-837a-e4f3afab77f3 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.523523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc7d0-7058-49a8-a372-f139a26313e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.524030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc7d0-7058-49a8-a372-f139a26313e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.524300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc7d0-7058-49a8-a372-f139a26313e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.524569 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc7d0-7058-49a8-a372-f139a26313e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.525262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc7d0-7058-49a8-a372-f139a26313e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.526846 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc7d0-7058-49a8-a372-f139a26313e3 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.539383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1201/2378] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:47.544096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.557242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1febd-6ec2-42cf-9516-18e4422bf8e7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.565805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.566478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.566754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.567023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] PATH_INFO: `/v3/projects/a3f8244dfb1e4442acbaf27ba11e6cd8/users/eb480a47fa7641a3b8cb7effa2b5f455/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.568975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f8244dfb1e4442acbaf27ba11e6cd8, user_id=eb480a47fa7641a3b8cb7effa2b5f455, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.571847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.587940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1178/2379] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:47 2022] PUT /identity/v3/projects/a3f8244dfb1e4442acbaf27ba11e6cd8/users/eb480a47fa7641a3b8cb7effa2b5f455/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:47.599678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.599872 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.600110 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.637866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] MFA Rules not processed for user `eb480a47fa7641a3b8cb7effa2b5f455`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:47.639080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:47.651151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:47.739610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1202/2380] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:47.751810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:47.753852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:47.849259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a456b7e-7e32-4627-804f-8b826abdfe5f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:47.854245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:47.854391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:47.854652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:47.854925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:47.866827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:47.868274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:47.884665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1179/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:49.210588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:49.213118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:49.302520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6779550-8d0a-4e0a-b5fb-3dead2d101bb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:49.324470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:49.325144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:49.325422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:49.325690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:49.329837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:49.412233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:49.414030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc7a1f-92c6-442a-b3a9-0d2d924d7a89 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:49.427192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1203/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:49.747640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:49.762975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d8fa-6f43-46cd-b689-4396a62cd188 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:49.771894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:49.772710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:49.773055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:49.773324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] PATH_INFO: `/v3/users/1c91f424f64a4c7db020cae720393a81` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:49.775222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c91f424f64a4c7db020cae720393a81)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:49.777224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:49.846064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c91f424f64a4c7db020cae720393a81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:49.853924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c91f424f64a4c7db020cae720393a81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:49.854652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c91f424f64a4c7db020cae720393a81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:49.855273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c91f424f64a4c7db020cae720393a81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:49.866725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c91f424f64a4c7db020cae720393a81'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:49.888047 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1180/2383] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:49 2022] DELETE /identity/v3/users/1c91f424f64a4c7db020cae720393a81 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:49.893464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:49.893464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:49.893727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:49.919822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:49.922057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:49.994587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:50.012938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1204/2384] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:50.022938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:50.024688 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:50.049223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:50.125993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb969a6-cd8e-4ec0-9806-267985bd5ed9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:50.130680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:50.131319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:50.131598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:50.132023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:50.142783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:50.144503 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:50.159212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1181/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:50.750651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:50.752493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:50.767315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61f68f-554b-4ec5-9960-1b52d5f25e83 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:50.772279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:50.772988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:50.773266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:50.773584 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] PATH_INFO: `/v3/projects/e76121813b894b0a9d11fe3939a21731` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:50.774727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76121813b894b0a9d11fe3939a21731)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:50.776659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:50.861769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76121813b894b0a9d11fe3939a21731', 'request_id': 'req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:50.872248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76121813b894b0a9d11fe3939a21731', 'request_id': 'req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:50.882755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76121813b894b0a9d11fe3939a21731', 'request_id': 'req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:50.913479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] The token cache is being invalidate because project e76121813b894b0a9d11fe3939a21731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:50.913826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:50.917317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:50.919602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1205/2386] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:50 2022] DELETE /identity/v3/projects/e76121813b894b0a9d11fe3939a21731 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:50.924124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:50.940704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86be51-39bf-44b3-9bc6-a697f648b262 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:51.047617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:51.048397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:51.048687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:51.049073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] PATH_INFO: `/v3/users/eb480a47fa7641a3b8cb7effa2b5f455` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:51.050178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb480a47fa7641a3b8cb7effa2b5f455)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:51.052090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:51.120841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb480a47fa7641a3b8cb7effa2b5f455'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:51.130164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb480a47fa7641a3b8cb7effa2b5f455'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:51.131202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb480a47fa7641a3b8cb7effa2b5f455'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:51.131995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb480a47fa7641a3b8cb7effa2b5f455'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:51.144114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e61a9c1e-50d2-4dc6-93cd-0d652e90cb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb480a47fa7641a3b8cb7effa2b5f455'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:51.177563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1182/2387] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:50 2022] DELETE /identity/v3/users/eb480a47fa7641a3b8cb7effa2b5f455 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:51.954850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:51.957056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:51.981016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a0ff-5b1c-49b7-b1e4-d3cdc3f714a2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.097225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.098266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.099055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.099566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] PATH_INFO: `/v3/projects/a3f8244dfb1e4442acbaf27ba11e6cd8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.101337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f8244dfb1e4442acbaf27ba11e6cd8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.103466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.185151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f8244dfb1e4442acbaf27ba11e6cd8', 'request_id': 'req-cf420ce6-c840-4033-883f-8ff2a69ad419'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:52.197551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f8244dfb1e4442acbaf27ba11e6cd8', 'request_id': 'req-cf420ce6-c840-4033-883f-8ff2a69ad419'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:52.207360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f8244dfb1e4442acbaf27ba11e6cd8', 'request_id': 'req-cf420ce6-c840-4033-883f-8ff2a69ad419'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:52.235285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] The token cache is being invalidate because project a3f8244dfb1e4442acbaf27ba11e6cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:52.236310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:52.237045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cf420ce6-c840-4033-883f-8ff2a69ad419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:52.238845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1206/2388] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:51 2022] DELETE /identity/v3/projects/a3f8244dfb1e4442acbaf27ba11e6cd8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:52.243933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.244429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.244515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.282271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:52.284663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:52.333459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:52.411969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1183/2389] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:28:52.413757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.414040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.414310 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.464010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:52.465295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:52.478003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1207/2390] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:52.483463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:52.498187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb3bce-d770-4b48-b408-183254bff990 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.509089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.509739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.510023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.511086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.511510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:28:52.512314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.515160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.537611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1184/2391] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:28:52.538741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:52.544054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:52.562330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715dbce-1d5e-4f7b-ab54-cd080471942d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.588538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.589769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.590442 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.590918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.591870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.594230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.646392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1208/2392] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:52 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:52.647528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:52.658785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921e1a-bc18-4be2-8237-842f839516e1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.742479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.743189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.743557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.744125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.744855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.747633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.779577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1185/2393] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:52 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:52.783764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:52.806957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b9928-ca37-420a-9aa6-975e58cf18fd admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.817157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.817888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.818262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.818633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.819381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.821167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.836817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1209/2394] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:52.841052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:52.859738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaa8c1-8688-47f2-aa62-022960ee3a54 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.864815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d24b27-de5e-4af4-a17c-f681b4ed5cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.865636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24b27-de5e-4af4-a17c-f681b4ed5cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.866013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24b27-de5e-4af4-a17c-f681b4ed5cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.866381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24b27-de5e-4af4-a17c-f681b4ed5cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.867181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d24b27-de5e-4af4-a17c-f681b4ed5cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.868908 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d24b27-de5e-4af4-a17c-f681b4ed5cf3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.885810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1186/2395] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:52.886756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:52.902483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e118-c699-4118-bfcf-c60ec22390c0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:52.908349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:52.909044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.909324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.909585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] PATH_INFO: `/v3/projects/0096f51e5f7a4b85af6867d2e221f68f/users/c81bf8691acf4eb3bdc0fec0ed0eddd9/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:52.926052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0096f51e5f7a4b85af6867d2e221f68f, user_id=c81bf8691acf4eb3bdc0fec0ed0eddd9, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:52.928732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:52.956832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1210/2396] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:52 2022] PUT /identity/v3/projects/0096f51e5f7a4b85af6867d2e221f68f/users/c81bf8691acf4eb3bdc0fec0ed0eddd9/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:52.966911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:52.967272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:52.967470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.014225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] MFA Rules not processed for user `c81bf8691acf4eb3bdc0fec0ed0eddd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:53.015747 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:53.149586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1187/2397] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:53.160080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:53.285992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a689b-5cd6-4aec-8439-bef87ddbe4d5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:53.293688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:53.294259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.295297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.295531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.297189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:53.299764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:53.349656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1211/2398] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:53 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:53.353820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:53.366974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83962c64-a03d-4239-a92b-7bb1c38c8038 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:53.398592 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:53.445519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:53.446313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.446731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.447123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.449010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:53.453197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:53.505150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1188/2399] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:53 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:53.517215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:53.536805 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c560e-11a9-480a-b9a8-752dff2b342d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:53.548589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:53.549818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.550166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.551489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.553235 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:53.555803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:53.574439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1212/2400] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:28:53.578871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:53.594255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531c961-f442-41e1-8999-91a5cc771733 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:53.605091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:53.607634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.607634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.607634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] PATH_INFO: `/v3/projects/be6104920eb045f4bde1d9c43a06c021/users/4a067fe5df3345f793dd4a0bf1efa470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.625907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6104920eb045f4bde1d9c43a06c021, user_id=4a067fe5df3345f793dd4a0bf1efa470, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:53.629173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:53.664821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1189/2401] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:53 2022] PUT /identity/v3/projects/be6104920eb045f4bde1d9c43a06c021/users/4a067fe5df3345f793dd4a0bf1efa470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:53.667687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:53.680169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf500e-a1ed-4f72-be62-7cd6acf84d62 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:53.800736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c940f2-4e9f-44af-b3a6-7fc7ad5bef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:53.801401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c940f2-4e9f-44af-b3a6-7fc7ad5bef23 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.801744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c940f2-4e9f-44af-b3a6-7fc7ad5bef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.802056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c940f2-4e9f-44af-b3a6-7fc7ad5bef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.802724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c940f2-4e9f-44af-b3a6-7fc7ad5bef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:53.806723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c940f2-4e9f-44af-b3a6-7fc7ad5bef23 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:53.825511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1213/2402] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:53.830395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:53.845695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc4d0-2b34-4029-b457-c7561585fae4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:53.853915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:53.854845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.855671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.856045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] PATH_INFO: `/v3/projects/be6104920eb045f4bde1d9c43a06c021/users/4a067fe5df3345f793dd4a0bf1efa470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.859237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6104920eb045f4bde1d9c43a06c021, user_id=4a067fe5df3345f793dd4a0bf1efa470, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:53.862894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:53.883966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1190/2403] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:53 2022] PUT /identity/v3/projects/be6104920eb045f4bde1d9c43a06c021/users/4a067fe5df3345f793dd4a0bf1efa470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:53.895015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:53.895317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:53.895643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:53.939467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] MFA Rules not processed for user `4a067fe5df3345f793dd4a0bf1efa470`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:53.940715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:53.947042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:54.066579 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1214/2404] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:28:54.082464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:54.087030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:54.229254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11300-fc86-4bf1-8933-675b2033c544 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:54.235060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:54.235941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:54.236371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:54.236819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:54.320878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:54.322583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:54.337984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1191/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:54.372832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:54.372832 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:54.467043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e5cec-1ded-4517-9a72-20d45bd82eea None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:54.472199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:54.472873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:54.473156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:54.473424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] PATH_INFO: `/v3/users/8efaf0eb944e4f0bac9a77bca9b68e26` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:54.474556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efaf0eb944e4f0bac9a77bca9b68e26)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:54.476670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:54.570178 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efaf0eb944e4f0bac9a77bca9b68e26'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:54.571247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efaf0eb944e4f0bac9a77bca9b68e26'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:54.572200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efaf0eb944e4f0bac9a77bca9b68e26'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:54.583890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efaf0eb944e4f0bac9a77bca9b68e26'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:54.598547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbc25acd-5bc3-4eff-ad32-02a6ff675aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efaf0eb944e4f0bac9a77bca9b68e26'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:54.637013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1215/2406] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:28:54 2022] DELETE /identity/v3/users/8efaf0eb944e4f0bac9a77bca9b68e26 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:54.980139 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:54.992328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6cbe3-f11a-43db-8c9c-5a26dd9639b7 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.041454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:55.091930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.094566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.094929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.095508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] PATH_INFO: `/v3/projects/3bf670dfebde4162b335b33c80afeffb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.106065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf670dfebde4162b335b33c80afeffb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.108701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.180338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf670dfebde4162b335b33c80afeffb', 'request_id': 'req-82383e86-9aa3-47c4-8206-75011c9c98fc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:55.192825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf670dfebde4162b335b33c80afeffb', 'request_id': 'req-82383e86-9aa3-47c4-8206-75011c9c98fc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:55.205108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf670dfebde4162b335b33c80afeffb', 'request_id': 'req-82383e86-9aa3-47c4-8206-75011c9c98fc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:55.230848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] The token cache is being invalidate because project 3bf670dfebde4162b335b33c80afeffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:28:55.232919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:55.234092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82383e86-9aa3-47c4-8206-75011c9c98fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:28:55.239526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1192/2407] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:28:54 2022] DELETE /identity/v3/projects/3bf670dfebde4162b335b33c80afeffb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:28:55.244639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.245670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.246129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.290159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:55.291657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:55.310307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:55.397084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1216/2408] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:55.405158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.412056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.412056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.440654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:55.442317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:55.454355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1193/2409] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:55.459138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.469960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46b853-a57f-45b7-8250-567ac0fc2d59 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.476002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.477008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.477491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.477956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.478628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:28:55.478936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.480662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.496816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1217/2410] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:28:55.501082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.511429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c259c4-1e33-4cf6-bcda-7e05d600dc0f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.517443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.518055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.518334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.518855 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.519505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.521250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.555518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1194/2411] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:28:55 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:28:55.559640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.574383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81d58c-3cea-4746-8756-bc580821a2ba admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.652830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.653666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.654207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.654590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.655623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.657990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.685050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1218/2412] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:28:55 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:28:55.689812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.702583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d35919-a8dc-4d34-bf27-393fc008e800 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.708266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.708910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.709200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.709591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.710241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.711878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.726513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1195/2413] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:55.727856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.739455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15496be2-0099-4351-a7d4-a3358ede597a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.744347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832487f1-4c86-4506-b05b-7f31b4f74f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.744991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832487f1-4c86-4506-b05b-7f31b4f74f77 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.745269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832487f1-4c86-4506-b05b-7f31b4f74f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.745543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832487f1-4c86-4506-b05b-7f31b4f74f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.746197 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832487f1-4c86-4506-b05b-7f31b4f74f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.747818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832487f1-4c86-4506-b05b-7f31b4f74f77 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.759920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1219/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:28:55.764748 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.775246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace47c-cc73-415d-8760-64bb84f72115 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:55.786254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:55.786933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.787217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.787857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] PATH_INFO: `/v3/projects/c0f8119a4e9e414f8541ede4aba21d3a/users/64a12e95af32429696ad5eef23eb9da3/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.810002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f8119a4e9e414f8541ede4aba21d3a, user_id=64a12e95af32429696ad5eef23eb9da3, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:55.813469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:55.832819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1196/2415] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:28:55 2022] PUT /identity/v3/projects/c0f8119a4e9e414f8541ede4aba21d3a/users/64a12e95af32429696ad5eef23eb9da3/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:28:55.841186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:55.841535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:55.841880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:55.872197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.875563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:55.883847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] MFA Rules not processed for user `64a12e95af32429696ad5eef23eb9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:28:55.887847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:55.977969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1220/2416] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:28:55.993864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:28:55.995527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:55.995859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6fd9-25b5-4e81-af50-4beb91f6accd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:56.008666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:56.009964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:56.010406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:56.010905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:56.014011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:28:56.024525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:56.037732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:28:56.097457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9a689-d1bf-4e73-a9d2-c3a327a03a85 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:28:56.105361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ada947-40dd-4768-8fa2-c1dfca80758a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:28:56.106060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada947-40dd-4768-8fa2-c1dfca80758a service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:28:56.106416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada947-40dd-4768-8fa2-c1dfca80758a service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:28:56.106753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada947-40dd-4768-8fa2-c1dfca80758a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:28:56.114411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:56.115997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:56.117162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ada947-40dd-4768-8fa2-c1dfca80758a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:28:56.120443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ada947-40dd-4768-8fa2-c1dfca80758a service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:28:56.126809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1197/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:28:56.149215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1221/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:28:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:00.089369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:00.090797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:00.156522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4d0ed-60cc-4927-b0d4-2d9ae87a50c3 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:00.160978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:00.161593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:00.161864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:00.162130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] PATH_INFO: `/v3/users/c81bf8691acf4eb3bdc0fec0ed0eddd9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:00.163211 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81bf8691acf4eb3bdc0fec0ed0eddd9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:00.165168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:00.210733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81bf8691acf4eb3bdc0fec0ed0eddd9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.217938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81bf8691acf4eb3bdc0fec0ed0eddd9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.218874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81bf8691acf4eb3bdc0fec0ed0eddd9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.219507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81bf8691acf4eb3bdc0fec0ed0eddd9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.226894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81bf8691acf4eb3bdc0fec0ed0eddd9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.244629 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1198/2419] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:00 2022] DELETE /identity/v3/users/c81bf8691acf4eb3bdc0fec0ed0eddd9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:00.249258 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:00.249835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:00.250735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:00.270086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:00.271290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:00.338790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1222/2420] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:00.350879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:00.352742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:00.396841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:00.424883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e9aa-ec98-44d3-9027-11da3e757239 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:00.428557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:00.429200 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:00.429481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:00.429753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:00.439913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:00.441369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:00.451543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1199/2421] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:00.730822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:00.732479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:00.748330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c73a-1664-4616-bc5b-01eed3e36e77 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:00.754230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:00.754948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:00.755305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:00.755644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] PATH_INFO: `/v3/projects/0096f51e5f7a4b85af6867d2e221f68f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:00.757709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0096f51e5f7a4b85af6867d2e221f68f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:00.760119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:00.813073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0096f51e5f7a4b85af6867d2e221f68f', 'request_id': 'req-f3fc0423-78e9-4531-a563-0b811baf0a44'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.820445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0096f51e5f7a4b85af6867d2e221f68f', 'request_id': 'req-f3fc0423-78e9-4531-a563-0b811baf0a44'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.826860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0096f51e5f7a4b85af6867d2e221f68f', 'request_id': 'req-f3fc0423-78e9-4531-a563-0b811baf0a44'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.841190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] The token cache is being invalidate because project 0096f51e5f7a4b85af6867d2e221f68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:00.841474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.842114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:00.843675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1223/2422] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:00 2022] DELETE /identity/v3/projects/0096f51e5f7a4b85af6867d2e221f68f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:00.848074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:00.858068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300380-0124-4cc6-af67-9d512b878860 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:00.946653 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:00.947389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:00.947983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:00.948338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] PATH_INFO: `/v3/users/4a067fe5df3345f793dd4a0bf1efa470` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:00.949596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a067fe5df3345f793dd4a0bf1efa470)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:00.951593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:01.032078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a067fe5df3345f793dd4a0bf1efa470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.041276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a067fe5df3345f793dd4a0bf1efa470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.042346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a067fe5df3345f793dd4a0bf1efa470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.043152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a067fe5df3345f793dd4a0bf1efa470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.050566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b71ff2d-2eff-42ff-b6c8-04fea962fd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a067fe5df3345f793dd4a0bf1efa470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.070165 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1200/2423] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:00 2022] DELETE /identity/v3/users/4a067fe5df3345f793dd4a0bf1efa470 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:01.351653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.353206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.366303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc0423-78e9-4531-a563-0b811baf0a44 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:01.401003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:01.457593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:01.458722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.459008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.459685 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] PATH_INFO: `/v3/projects/be6104920eb045f4bde1d9c43a06c021` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.461650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6104920eb045f4bde1d9c43a06c021)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:01.464739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:01.543862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6104920eb045f4bde1d9c43a06c021', 'request_id': 'req-7882533b-cb58-4064-a998-e1e9e8eae98d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.548424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6104920eb045f4bde1d9c43a06c021', 'request_id': 'req-7882533b-cb58-4064-a998-e1e9e8eae98d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.554611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6104920eb045f4bde1d9c43a06c021', 'request_id': 'req-7882533b-cb58-4064-a998-e1e9e8eae98d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.569742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] The token cache is being invalidate because project be6104920eb045f4bde1d9c43a06c021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:01.570035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.570666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.572939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1224/2424] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:01 2022] DELETE /identity/v3/projects/be6104920eb045f4bde1d9c43a06c021 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:01.578343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910486-d0a2-43f1-a725-723a7fc0f5be None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.579216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910486-d0a2-43f1-a725-723a7fc0f5be None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.579654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910486-d0a2-43f1-a725-723a7fc0f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.601469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.602931 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.611283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bb910486-d0a2-43f1-a725-723a7fc0f5be None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:01.612498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb910486-d0a2-43f1-a725-723a7fc0f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.669394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:01.673286 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882533b-cb58-4064-a998-e1e9e8eae98d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:01.678769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:01.679401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.679676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.679948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] PATH_INFO: `/v3/users/64a12e95af32429696ad5eef23eb9da3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.681624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a12e95af32429696ad5eef23eb9da3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:01.683752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:01.688834 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1201/2425] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:01.697460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.698065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.698386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.719496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:01.720517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.728386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1202/2426] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:01.732472 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.733266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a12e95af32429696ad5eef23eb9da3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.734550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a12e95af32429696ad5eef23eb9da3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.735190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a12e95af32429696ad5eef23eb9da3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.741974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daa0b7-aba1-4afc-a83e-502f88c58c10 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:01.742833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a12e95af32429696ad5eef23eb9da3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.745086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:01.747136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:01.747724 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.747995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.748260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.748938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:01.749346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:01.751687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:01.753625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-52da8d8a-a3ab-4e53-b835-b6ee09acd5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a12e95af32429696ad5eef23eb9da3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:01.763689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1203/2427] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:29:01.768325 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.769978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.771933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1225/2428] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:01 2022] DELETE /identity/v3/users/64a12e95af32429696ad5eef23eb9da3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:01.776066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.776299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.776561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.782305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58715046-9510-4e71-ac25-33daa27b1bf0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:01.795059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:01.796859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.846564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:01.847597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.848085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.848354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.849005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:01.850918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:01.858655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1226/2429] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:01.868979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.870393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:01.880497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1204/2430] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:01 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:01.884437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.936410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a655cb-89a4-4154-a076-88739a0aaffb None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:01.950326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9caf-0133-4598-b68c-d8fa708259d3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:01.955763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:01.956391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.956670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.956968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.957585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:01.959480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:01.985136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1205/2431] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:01 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:01.986217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:01.990864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:01.991473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:01.991747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:01.992014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:01.997303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80507-e24d-4103-b203-711f08b6f7fe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.001678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.001990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.002581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.002860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.003116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.003250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.003750 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.005350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.013004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1227/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:02.016813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1206/2433] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:02.021236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.031998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abff4c-5d39-404a-8e2a-78e8b2311143 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.037369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f626-324e-4175-8cfa-433011017812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.038035 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f626-324e-4175-8cfa-433011017812 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.038379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f626-324e-4175-8cfa-433011017812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.038719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f626-324e-4175-8cfa-433011017812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.039477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f626-324e-4175-8cfa-433011017812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.041462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f626-324e-4175-8cfa-433011017812 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.057810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1228/2434] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:02.058507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.071122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6c8e-15e4-4739-9641-030438351b94 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.076574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.077310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.077594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.078030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] PATH_INFO: `/v3/projects/0049e9430e8748398b902de15e968722/users/5249a1ea76224616a5ea4832b96890b3/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.096043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0049e9430e8748398b902de15e968722, user_id=5249a1ea76224616a5ea4832b96890b3, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.099157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.115957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1207/2435] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:02 2022] PUT /identity/v3/projects/0049e9430e8748398b902de15e968722/users/5249a1ea76224616a5ea4832b96890b3/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:02.126901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.127231 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.127510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.159937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] MFA Rules not processed for user `5249a1ea76224616a5ea4832b96890b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:02.161369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.173593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:02.246877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1229/2436] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:02.248500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.264314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:02.339482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55eb0f-f682-44f9-b43a-752d5ce94037 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.344471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.345210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.345415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.345685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.346332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.348227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.384550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1208/2437] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:02.388555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.401222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02aa9-eb53-498b-8fa3-5823280a1ac9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.470918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.472916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.474240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.474894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.475167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.475440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.476149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.478467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.490668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f69742-cabe-4e3d-81e9-1f0341b91d7b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.497223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.498081 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.498470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.498877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] PATH_INFO: `/v3/projects/c0f8119a4e9e414f8541ede4aba21d3a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.501314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f8119a4e9e414f8541ede4aba21d3a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.504616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.508227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1230/2438] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:02.512020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.523893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d33b3f-a3df-425b-8f5c-4e357daf9588 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.528952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.529594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.530047 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.530331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.531316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.533023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.545086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1231/2439] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:02.550313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.561731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898f15-6d7c-4bf1-a28a-70c3c17b2d5e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.564241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f8119a4e9e414f8541ede4aba21d3a', 'request_id': 'req-17e8262e-de2c-43a8-b257-fe91b048031f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:02.574928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f8119a4e9e414f8541ede4aba21d3a', 'request_id': 'req-17e8262e-de2c-43a8-b257-fe91b048031f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:02.583070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f8119a4e9e414f8541ede4aba21d3a', 'request_id': 'req-17e8262e-de2c-43a8-b257-fe91b048031f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:02.595509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] The token cache is being invalidate because project c0f8119a4e9e414f8541ede4aba21d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:02.595739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:02.596410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-17e8262e-de2c-43a8-b257-fe91b048031f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:02.598243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1209/2440] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:02 2022] DELETE /identity/v3/projects/c0f8119a4e9e414f8541ede4aba21d3a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:02.604298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea367c3-34fc-4017-b83a-c8f5426b2419 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.604591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea367c3-34fc-4017-b83a-c8f5426b2419 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.605250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea367c3-34fc-4017-b83a-c8f5426b2419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.628662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0ea367c3-34fc-4017-b83a-c8f5426b2419 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:02.630603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0ea367c3-34fc-4017-b83a-c8f5426b2419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.633066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.633734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.634011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.634281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] PATH_INFO: `/v3/projects/ef375bd20d73473db3a9fff341945eb1/users/3a274d9a655d4a8c90b21e222b93909a/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.642010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1210/2441] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:02.650095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.650612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.650892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.651517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef375bd20d73473db3a9fff341945eb1, user_id=3a274d9a655d4a8c90b21e222b93909a, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.655975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.670856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1232/2442] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:02 2022] PUT /identity/v3/projects/ef375bd20d73473db3a9fff341945eb1/users/3a274d9a655d4a8c90b21e222b93909a/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:02.675692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.676126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:02.677361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.677887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.693228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:02.745187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1211/2443] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:02.749447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.752103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09557636-946c-4877-a3f7-8ab785de503b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.758729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.759128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee55c-85f7-453d-9c68-e1ad8ea087ff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.759332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.759605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.760233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.761236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.762812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.764255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.765512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.765890 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.766522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.766964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:02.767265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.768886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.775598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1233/2444] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:02.780916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.789595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1212/2445] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:29:02.790585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.794116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f54a2-d18d-4dc2-a0d6-19f42618a5d0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.795454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:02.802917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf88f0-01d8-493e-a8b8-172b3b8f69d8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.805525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc95ecf-a205-4ae5-bbf0-46e59666d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.806393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc95ecf-a205-4ae5-bbf0-46e59666d086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.806599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc95ecf-a205-4ae5-bbf0-46e59666d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.806890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc95ecf-a205-4ae5-bbf0-46e59666d086 admin admin] PATH_INFO: `/v3/projects/ef375bd20d73473db3a9fff341945eb1/users/3a274d9a655d4a8c90b21e222b93909a/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.810484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.810641 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc95ecf-a205-4ae5-bbf0-46e59666d086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef375bd20d73473db3a9fff341945eb1, user_id=3a274d9a655d4a8c90b21e222b93909a, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.811286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.811622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.812000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.813272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.813754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc95ecf-a205-4ae5-bbf0-46e59666d086 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.815860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.825445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1234/2446] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:02 2022] PUT /identity/v3/projects/ef375bd20d73473db3a9fff341945eb1/users/3a274d9a655d4a8c90b21e222b93909a/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:02.836973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.837248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.837541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.851672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1213/2447] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:02.852880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.873880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] MFA Rules not processed for user `3a274d9a655d4a8c90b21e222b93909a`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:02.875124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.919155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3eb0b-5b30-441f-b039-78363da4eb06 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.925296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.925988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.926326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.926683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.927209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.929131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.952113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1214/2448] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:02.957775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.963118 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1235/2449] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:02.969717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946c58-1d46-466c-b149-9026912a919d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:02.970923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:02.972490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:02.975428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:02.976134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:02.976408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:02.976676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:02.977467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:02.979156 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:02.991343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1215/2450] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:02.995458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:03.005461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78318a-5725-42e3-a195-3d856c112e7a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.014110 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:03.015250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.015535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.016239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.016924 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:03.018913 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:03.031951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1216/2451] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:03.037010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:03.038635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608beff-8ab3-4c0e-95bd-aa6ecdd304df None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.044502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13410a3e-d8d7-4257-95be-2abbbca7b034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:03.045382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13410a3e-d8d7-4257-95be-2abbbca7b034 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.045870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13410a3e-d8d7-4257-95be-2abbbca7b034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.046254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13410a3e-d8d7-4257-95be-2abbbca7b034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.047283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a5fb4-98c9-494f-8e15-218d4ec647fb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.052099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:03.052755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.053064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.053338 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] PATH_INFO: `/v3/projects/8eb7d570e5f942498a71bf5a53a84179/users/28569e0579d746539e8211fafe88f750/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.058123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13410a3e-d8d7-4257-95be-2abbbca7b034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:03.061998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13410a3e-d8d7-4257-95be-2abbbca7b034 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:03.071391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb7d570e5f942498a71bf5a53a84179, user_id=28569e0579d746539e8211fafe88f750, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:03.074033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1236/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:03.084571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:03.100871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1217/2453] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:03 2022] PUT /identity/v3/projects/8eb7d570e5f942498a71bf5a53a84179/users/28569e0579d746539e8211fafe88f750/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:03.111415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7217-f0df-476e-91b3-0cd13cd084b2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.111698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7217-f0df-476e-91b3-0cd13cd084b2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.111966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7217-f0df-476e-91b3-0cd13cd084b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.164520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7e6b7217-f0df-476e-91b3-0cd13cd084b2 None None] MFA Rules not processed for user `28569e0579d746539e8211fafe88f750`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:03.165952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7e6b7217-f0df-476e-91b3-0cd13cd084b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:03.180260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:03.244222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1237/2454] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:03.258857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:03.261736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:03.332625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068445-971a-4f22-9600-0892fd73f291 None None] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.332995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068445-971a-4f22-9600-0892fd73f291 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.333440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068445-971a-4f22-9600-0892fd73f291 None None] PATH_INFO: `/` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.335222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1238/2455] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 28 12:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 12:29:03.341153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.341505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.341983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.351447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e565c-8668-4e8a-8791-15dd622e57ba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.366019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:03.366646 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.366919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.367182 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.370417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] MFA Rules not processed for user `a5e487f1b5af4aa0a2d922d374adc29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:03.371662 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:03.379478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:03.380176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:03.403084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1218/2456] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:03.504961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1239/2457] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 28 12:29:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:03.517963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:03.519412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:03.556289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:03.590201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0aa66-d150-4cce-a8ad-ce1c20bd91bc service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.594440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36671-cd4b-4482-895c-e7360c288643 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:03.595057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36671-cd4b-4482-895c-e7360c288643 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.595334 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36671-cd4b-4482-895c-e7360c288643 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.595603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36671-cd4b-4482-895c-e7360c288643 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.610124 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36671-cd4b-4482-895c-e7360c288643 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:03.611567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36671-cd4b-4482-895c-e7360c288643 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:03.616986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:03.623920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1219/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:03.709064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3df6-7419-4054-a50e-170d8c4dfb98 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.714595 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:03.715317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.715667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.716010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] PATH_INFO: `/v3/users/5249a1ea76224616a5ea4832b96890b3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.717377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5249a1ea76224616a5ea4832b96890b3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:03.720216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:03.784191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5249a1ea76224616a5ea4832b96890b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:03.785694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5249a1ea76224616a5ea4832b96890b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:03.786509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5249a1ea76224616a5ea4832b96890b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:03.788379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:03.796837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5249a1ea76224616a5ea4832b96890b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:03.809376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5249a1ea76224616a5ea4832b96890b3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:03.830499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1240/2459] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:03 2022] DELETE /identity/v3/users/5249a1ea76224616a5ea4832b96890b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:03.835011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:03.835375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:03.835720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:03.855362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:03.856557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:03.916260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1220/2460] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:03.926420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:03.928050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:03.994844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cc8e7-6901-4f70-a7da-fe38bb143105 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:03.999284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:04.000031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:04.000304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:04.000567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:04.013345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:04.015647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:04.029492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1241/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:04.305941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:04.307467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:04.322025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a847-1214-4cf8-9196-cd3e1a837941 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:04.328059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:04.329114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:04.329442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:04.329781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] PATH_INFO: `/v3/projects/0049e9430e8748398b902de15e968722` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:04.331038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0049e9430e8748398b902de15e968722)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:04.333154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:04.387446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0049e9430e8748398b902de15e968722', 'request_id': 'req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.395948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0049e9430e8748398b902de15e968722', 'request_id': 'req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.402230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0049e9430e8748398b902de15e968722', 'request_id': 'req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.413984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] The token cache is being invalidate because project 0049e9430e8748398b902de15e968722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:04.414359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.421417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.424853 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1221/2462] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:04 2022] DELETE /identity/v3/projects/0049e9430e8748398b902de15e968722 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:04.428215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:04.438754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c1a8-8821-4ff3-8777-c6a5ec102b37 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:04.496578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:04.497226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:04.497502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:04.497769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] PATH_INFO: `/v3/users/3a274d9a655d4a8c90b21e222b93909a` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:04.498882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a274d9a655d4a8c90b21e222b93909a)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:04.501426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:04.548547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a274d9a655d4a8c90b21e222b93909a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.549723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a274d9a655d4a8c90b21e222b93909a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.550353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a274d9a655d4a8c90b21e222b93909a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.557603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a274d9a655d4a8c90b21e222b93909a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.565368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5bf74419-fe27-4f55-b2c8-8d71e7af3b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a274d9a655d4a8c90b21e222b93909a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:04.571287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:04.585556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1242/2463] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:04 2022] DELETE /identity/v3/users/3a274d9a655d4a8c90b21e222b93909a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:04.979505 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:04.981296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:04.995075 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b57a0-62ec-4fb8-bd72-b1e20edd0f84 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.049868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:05.062198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.063380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.063809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.064845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] PATH_INFO: `/v3/projects/ef375bd20d73473db3a9fff341945eb1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.066895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef375bd20d73473db3a9fff341945eb1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.069059 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.127144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef375bd20d73473db3a9fff341945eb1', 'request_id': 'req-73bf053b-4142-4895-a7e3-129f3f17277b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:05.136064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef375bd20d73473db3a9fff341945eb1', 'request_id': 'req-73bf053b-4142-4895-a7e3-129f3f17277b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:05.143640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef375bd20d73473db3a9fff341945eb1', 'request_id': 'req-73bf053b-4142-4895-a7e3-129f3f17277b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:05.178236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] The token cache is being invalidate because project ef375bd20d73473db3a9fff341945eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:05.178810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:05.185266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73bf053b-4142-4895-a7e3-129f3f17277b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:05.188032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1222/2464] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:04 2022] DELETE /identity/v3/projects/ef375bd20d73473db3a9fff341945eb1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:05.192830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.193237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.193924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.224958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:05.226409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:05.297167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1243/2465] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:05.305231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.305514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.305784 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.329120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:05.330379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:05.346115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1223/2466] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:05.347473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.357291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8d75-4f15-46e6-874e-32590da21572 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.362845 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.363450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.363723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.363993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.364645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:05.364975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.366572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.379309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1244/2467] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:05.384002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.394256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70558882-a5cd-44d8-8704-d4bf4107e08f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.399725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.400545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.400845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.401111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.401731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.403630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.434341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1224/2468] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:05 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:05.439114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.450159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99731-6247-46db-b3b3-6beb300352c7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.508844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.509489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.509768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.510050 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.510873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.512841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.533345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1245/2469] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:05 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:05.537772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.548962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5799-62fa-4392-8b15-3d6f77bd5e85 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.553585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.554175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.554451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.554725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.555406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.557091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.567634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1225/2470] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:05.571911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.582277 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04934e22-6ab7-412b-b664-273044ca63a6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.586941 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55afe2-579e-4704-a9a4-d1c356df0ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.587535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55afe2-579e-4704-a9a4-d1c356df0ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.587811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55afe2-579e-4704-a9a4-d1c356df0ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.588081 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55afe2-579e-4704-a9a4-d1c356df0ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.588721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55afe2-579e-4704-a9a4-d1c356df0ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.590350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55afe2-579e-4704-a9a4-d1c356df0ef4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.602262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1246/2471] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:05.606631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.617257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd051fb-bebc-487a-9409-236d4c48cc0a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.621860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf316a0-1668-4bad-9fc2-e2a9727a619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.622497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf316a0-1668-4bad-9fc2-e2a9727a619c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.622774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf316a0-1668-4bad-9fc2-e2a9727a619c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.623043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf316a0-1668-4bad-9fc2-e2a9727a619c admin admin] PATH_INFO: `/v3/projects/ca35588452d34484b0ff019012289361/users/ed803ae2bd2b4d1eac9b0b278ccdfc22/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.634416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.634702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.634977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.637475 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf316a0-1668-4bad-9fc2-e2a9727a619c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca35588452d34484b0ff019012289361, user_id=ed803ae2bd2b4d1eac9b0b278ccdfc22, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.640144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf316a0-1668-4bad-9fc2-e2a9727a619c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.654725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1226/2472] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:05 2022] PUT /identity/v3/projects/ca35588452d34484b0ff019012289361/users/ed803ae2bd2b4d1eac9b0b278ccdfc22/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:05.655855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:05.657341 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:05.665605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.665960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.666296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.694359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] MFA Rules not processed for user `ed803ae2bd2b4d1eac9b0b278ccdfc22`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:05.695550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:05.709468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:05.721550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1247/2473] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:05.734658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.736317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:05.779543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1227/2474] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:05.793780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:05.795173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:05.808228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:05.816602 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a90d-2f46-496e-a058-05024d147a2e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.823195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.823620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.823893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.824160 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.834180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.835764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.844932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1248/2475] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:29:05.862866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f292b-e526-4e46-b358-50b624e22063 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:05.867372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d406d-8db1-436a-872c-7ff9c64d6b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:05.868004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d406d-8db1-436a-872c-7ff9c64d6b38 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:05.868289 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d406d-8db1-436a-872c-7ff9c64d6b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:05.868562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d406d-8db1-436a-872c-7ff9c64d6b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:05.878643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d406d-8db1-436a-872c-7ff9c64d6b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:05.880213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d406d-8db1-436a-872c-7ff9c64d6b38 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:05.895556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1228/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:05.944797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:06.054841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a47cc-cc50-4082-bbe0-742107dbc372 service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:06.067498 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:06.068727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:06.069464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:06.069992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] PATH_INFO: `/v3/users/ed803ae2bd2b4d1eac9b0b278ccdfc22` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:06.072509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed803ae2bd2b4d1eac9b0b278ccdfc22)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:06.078617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:06.169931 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed803ae2bd2b4d1eac9b0b278ccdfc22'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:06.170651 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed803ae2bd2b4d1eac9b0b278ccdfc22'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:06.171337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed803ae2bd2b4d1eac9b0b278ccdfc22'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:06.183372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed803ae2bd2b4d1eac9b0b278ccdfc22'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:06.198974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed803ae2bd2b4d1eac9b0b278ccdfc22'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:06.219134 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1249/2477] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:05 2022] DELETE /identity/v3/users/ed803ae2bd2b4d1eac9b0b278ccdfc22 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:06.223838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:06.224324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:06.224440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:06.253302 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:06.254553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:06.334887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1229/2478] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:06.349255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:06.350976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:06.368200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:06.478428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf49917-89aa-4e96-8031-d18bda06643a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:06.482463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945cc94-4d5f-47da-a8da-281889910a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:06.483159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cc94-4d5f-47da-a8da-281889910a01 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:06.483547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cc94-4d5f-47da-a8da-281889910a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:06.483821 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cc94-4d5f-47da-a8da-281889910a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:06.494758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945cc94-4d5f-47da-a8da-281889910a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:06.496368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945cc94-4d5f-47da-a8da-281889910a01 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:06.529095 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1250/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:06.975056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:06.976701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:06.996352 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76605757-abbe-4266-93d9-6809f37c7deb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.017912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.018970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.019480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.019962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] PATH_INFO: `/v3/projects/ca35588452d34484b0ff019012289361` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.021568 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca35588452d34484b0ff019012289361)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.024581 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.091270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca35588452d34484b0ff019012289361', 'request_id': 'req-4941f063-01db-40cc-b619-dc2474e08a68'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:07.112035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca35588452d34484b0ff019012289361', 'request_id': 'req-4941f063-01db-40cc-b619-dc2474e08a68'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:07.120798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca35588452d34484b0ff019012289361', 'request_id': 'req-4941f063-01db-40cc-b619-dc2474e08a68'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:07.134950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] The token cache is being invalidate because project ca35588452d34484b0ff019012289361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:07.136318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:07.137738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4941f063-01db-40cc-b619-dc2474e08a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:07.140215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1230/2480] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:06 2022] DELETE /identity/v3/projects/ca35588452d34484b0ff019012289361 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:07.146183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.146721 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.147026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.174512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:07.176447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:07.255404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1251/2481] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:07.264529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.265372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.265372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.291683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:07.293229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:07.302800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1231/2482] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:07.307241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.317102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7197-b26e-4e15-85fe-36dfc82317a6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.321918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.323094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.323474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.323751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.324468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:07.324797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.326828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.340022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1252/2483] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:07.345065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.361205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766ff34-9d6a-49a2-be1b-088d901cfa57 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.366430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.367040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.367317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.367574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.368217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.370131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.400828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1232/2484] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:07.404697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.419024 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40a9e-b2a7-4cbe-aa46-04d96c122e7b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.489296 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.489933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.490285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.490670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.491355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.493478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.523510 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1253/2485] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:07.527436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.541242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8af12-98de-42ae-b6d0-4167494ab6c8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.545980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.546586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.546861 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.547126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.547981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.549672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.551373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:07.565844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1233/2486] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:07.569511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.580957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c5163-f62b-4450-acdb-58a64e11eb5c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.586075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673f6a-a37c-4600-a448-356d777f5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.586689 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673f6a-a37c-4600-a448-356d777f5f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.586967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673f6a-a37c-4600-a448-356d777f5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.587236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673f6a-a37c-4600-a448-356d777f5f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.587891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673f6a-a37c-4600-a448-356d777f5f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.589521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673f6a-a37c-4600-a448-356d777f5f95 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.603256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1254/2487] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:07.610445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.621316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48727d-8fea-4a5b-9b82-3c3a810e248e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.626508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.627179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.627460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.627723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] PATH_INFO: `/v3/projects/c242d2fdb5da4c61b7d48b3f0783bffc/users/c46001c5349f48a4a0deaa3089b9beb0/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.646461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c242d2fdb5da4c61b7d48b3f0783bffc, user_id=c46001c5349f48a4a0deaa3089b9beb0, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.649152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.667880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1234/2488] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:07 2022] PUT /identity/v3/projects/c242d2fdb5da4c61b7d48b3f0783bffc/users/c46001c5349f48a4a0deaa3089b9beb0/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:07.678238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.678520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.678840 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.709778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] MFA Rules not processed for user `c46001c5349f48a4a0deaa3089b9beb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:07.711600 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:07.716665 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:07.787628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1255/2489] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:07.793151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.866161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1f1d-de7c-4b07-87aa-1cf7fabf94e4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:07.880511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:07.881288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:07.881571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:07.881870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:07.882480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:07.884381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:07.929377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1235/2490] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:07.937479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:07.950020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1de09-9dad-4e8d-89f0-ca59c502db87 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:08.021037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:08.021978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:08.022140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:08.022471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:08.023164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:08.025331 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:08.059799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1256/2491] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:07 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:08.064516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:08.078893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1897d-ce4c-4bb9-a42d-050f14d101ff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:08.090801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:08.091759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:08.093152 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:08.094663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:08.096618 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:08.100720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:08.129126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1236/2492] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:08.130336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:08.142010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81d7f4-b7b4-416a-ad1f-64d167add663 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:08.148636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:08.149445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:08.149739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:08.150078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] PATH_INFO: `/v3/projects/06eec6af05d74d9fa263f2f07650b605/users/49b2860fa69f40448d229b0d1332ec40/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:08.188753 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eec6af05d74d9fa263f2f07650b605, user_id=49b2860fa69f40448d229b0d1332ec40, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:08.202305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:08.232646 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1257/2493] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:08 2022] PUT /identity/v3/projects/06eec6af05d74d9fa263f2f07650b605/users/49b2860fa69f40448d229b0d1332ec40/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:08.237198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:08.254802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e34d5-eed7-42bb-a85d-46f27f1e7f45 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:08.394786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccf5c6-890e-4521-9a1d-439bd866a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:08.395689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf5c6-890e-4521-9a1d-439bd866a31d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:08.395997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf5c6-890e-4521-9a1d-439bd866a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:08.396267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccf5c6-890e-4521-9a1d-439bd866a31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:08.396938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccf5c6-890e-4521-9a1d-439bd866a31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:08.398661 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccf5c6-890e-4521-9a1d-439bd866a31d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:08.421668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1237/2494] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:08.424076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:08.444042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1f0da-68c6-4e26-9560-5d77850267ff admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:08.453525 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:08.455829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:08.457184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:08.457666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] PATH_INFO: `/v3/projects/06eec6af05d74d9fa263f2f07650b605/users/49b2860fa69f40448d229b0d1332ec40/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:08.464475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eec6af05d74d9fa263f2f07650b605, user_id=49b2860fa69f40448d229b0d1332ec40, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:08.474300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:08.500153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1258/2495] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:08 2022] PUT /identity/v3/projects/06eec6af05d74d9fa263f2f07650b605/users/49b2860fa69f40448d229b0d1332ec40/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:08.510403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca122-337a-442c-b100-0368879379c8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:08.511240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca122-337a-442c-b100-0368879379c8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:08.512454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca122-337a-442c-b100-0368879379c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:08.591401 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6cfca122-337a-442c-b100-0368879379c8 None None] MFA Rules not processed for user `49b2860fa69f40448d229b0d1332ec40`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:08.595052 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6cfca122-337a-442c-b100-0368879379c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:08.670194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:08.781063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1238/2496] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:08.819998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:08.821813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:08.993448 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288e806-2eb0-4a63-b1bb-4d3703ec43d1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:08.998592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eb861-f2cc-4d57-a48c-47e4bde173fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:09.000075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb861-f2cc-4d57-a48c-47e4bde173fc service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:09.000440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb861-f2cc-4d57-a48c-47e4bde173fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:09.000762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb861-f2cc-4d57-a48c-47e4bde173fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:09.014010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:09.111576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eb861-f2cc-4d57-a48c-47e4bde173fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:09.113126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eb861-f2cc-4d57-a48c-47e4bde173fc service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:09.126585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1259/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:11.950028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca122-337a-442c-b100-0368879379c8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:12.026183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca122-337a-442c-b100-0368879379c8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:12.032213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:12.032900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:12.033178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:12.033445 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] PATH_INFO: `/v3/users/c46001c5349f48a4a0deaa3089b9beb0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:12.034574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46001c5349f48a4a0deaa3089b9beb0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:12.036481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:12.097622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46001c5349f48a4a0deaa3089b9beb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.109805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46001c5349f48a4a0deaa3089b9beb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.111343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46001c5349f48a4a0deaa3089b9beb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.112077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46001c5349f48a4a0deaa3089b9beb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.119557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46001c5349f48a4a0deaa3089b9beb0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.166752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1239/2498] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:11 2022] DELETE /identity/v3/users/c46001c5349f48a4a0deaa3089b9beb0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:12.168920 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:12.169440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:12.169537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:12.199472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:12.200755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:12.292980 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1260/2499] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:12.304755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:12.306528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:12.385509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:12.394534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c2c01-e594-4d71-b7c0-fa552aab124e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:12.398076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:12.398675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:12.398948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:12.399213 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:12.410037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:12.411641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:12.422929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1240/2500] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:12.731350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:12.733791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:12.748684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4919d8b-76dc-4290-acda-0044e1f54319 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:12.767904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:12.768632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:12.769068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:12.769421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] PATH_INFO: `/v3/projects/c242d2fdb5da4c61b7d48b3f0783bffc` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:12.770722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c242d2fdb5da4c61b7d48b3f0783bffc)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:12.772857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:12.830722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c242d2fdb5da4c61b7d48b3f0783bffc', 'request_id': 'req-ec06bea9-d3ad-44f5-bc48-204767b997af'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.836910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c242d2fdb5da4c61b7d48b3f0783bffc', 'request_id': 'req-ec06bea9-d3ad-44f5-bc48-204767b997af'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.843080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c242d2fdb5da4c61b7d48b3f0783bffc', 'request_id': 'req-ec06bea9-d3ad-44f5-bc48-204767b997af'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.861541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] The token cache is being invalidate because project c242d2fdb5da4c61b7d48b3f0783bffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:12.861901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.862515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:12.867365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1261/2501] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:12 2022] DELETE /identity/v3/projects/c242d2fdb5da4c61b7d48b3f0783bffc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:12.868572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:12.880163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879d988-e914-410c-94e9-28b9a4be8d67 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:12.951868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:12.952826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:12.953215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:12.953687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] PATH_INFO: `/v3/users/49b2860fa69f40448d229b0d1332ec40` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:12.955367 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b2860fa69f40448d229b0d1332ec40)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:12.958075 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:12.971252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:12.972704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:12.989854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bea9-d3ad-44f5-bc48-204767b997af admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:12.996945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:12.997850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:12.998343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:12.999290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] PATH_INFO: `/v3/users/28569e0579d746539e8211fafe88f750` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.000803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28569e0579d746539e8211fafe88f750)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.002841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:13.020508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b2860fa69f40448d229b0d1332ec40'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.031355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b2860fa69f40448d229b0d1332ec40'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.032084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b2860fa69f40448d229b0d1332ec40'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.032760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b2860fa69f40448d229b0d1332ec40'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.045918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89f2aa41-250e-49f3-b0a4-b349937d6879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b2860fa69f40448d229b0d1332ec40'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.046447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:13.067075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28569e0579d746539e8211fafe88f750'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.068330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28569e0579d746539e8211fafe88f750'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.069434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28569e0579d746539e8211fafe88f750'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.084327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1241/2502] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:12 2022] DELETE /identity/v3/users/49b2860fa69f40448d229b0d1332ec40 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:13.110857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28569e0579d746539e8211fafe88f750'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.124347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28569e0579d746539e8211fafe88f750'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.160842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1262/2503] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:12 2022] DELETE /identity/v3/users/28569e0579d746539e8211fafe88f750 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:13.165594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.166032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.166432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.204709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:13.205888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.306874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1242/2504] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:13.316647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:13.318280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.439278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:13.441098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.458990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4e9ab-d310-4f93-b274-9ae9416df522 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:13.463203 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913e8b-e92e-400b-8be6-7a1c0135b40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:13.463508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d273c-bc6c-434a-be26-0ec7f37e621b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:13.464200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913e8b-e92e-400b-8be6-7a1c0135b40f service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.464639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913e8b-e92e-400b-8be6-7a1c0135b40f service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.465444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913e8b-e92e-400b-8be6-7a1c0135b40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.475783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:13.476802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.477195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.477559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] PATH_INFO: `/v3/projects/06eec6af05d74d9fa263f2f07650b605` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.479582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eec6af05d74d9fa263f2f07650b605)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.481634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:13.485030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:13.487870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913e8b-e92e-400b-8be6-7a1c0135b40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.489573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913e8b-e92e-400b-8be6-7a1c0135b40f service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:13.520667 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1263/2505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:13.566000 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eec6af05d74d9fa263f2f07650b605', 'request_id': 'req-0a221121-7777-41fc-9e58-0247fcd8def9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.575382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eec6af05d74d9fa263f2f07650b605', 'request_id': 'req-0a221121-7777-41fc-9e58-0247fcd8def9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.583249 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eec6af05d74d9fa263f2f07650b605', 'request_id': 'req-0a221121-7777-41fc-9e58-0247fcd8def9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.598381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] The token cache is being invalidate because project 06eec6af05d74d9fa263f2f07650b605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:13.598797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.599512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0a221121-7777-41fc-9e58-0247fcd8def9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.601553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1243/2506] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:13 2022] DELETE /identity/v3/projects/06eec6af05d74d9fa263f2f07650b605 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:13.607420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.607702 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.608433 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.632576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:13.634104 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.700334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1264/2507] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:13.710166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.710423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.710699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.731256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:13.732468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.740658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1244/2508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:13.745017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:13.754972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbba2d8-cb0e-414e-9bb3-e8f79d3c3df6 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:13.759732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:13.760363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.760640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.760949 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.761598 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:13.761930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.763643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:13.776816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1265/2509] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:13.781585 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:13.791886 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83c5f-36e5-4c2d-947b-249f11eac316 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:13.805499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:13.806304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.806531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.806791 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.807813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.809829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:13.815573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:13.817379 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.835566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc408f7-7115-45f7-ab6f-3724639fdda7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:13.841748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:13.843206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.843862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.843988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] PATH_INFO: `/v3/projects/8eb7d570e5f942498a71bf5a53a84179` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.845139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb7d570e5f942498a71bf5a53a84179)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.847770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:13.848640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1245/2510] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:13 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:13.852652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:13.886929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:13.904955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb7d570e5f942498a71bf5a53a84179', 'request_id': 'req-f0bc00b6-fe51-4808-9d6e-a979164b863a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.911866 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb7d570e5f942498a71bf5a53a84179', 'request_id': 'req-f0bc00b6-fe51-4808-9d6e-a979164b863a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.917145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a22e-4b73-4286-b40a-7e2a3a4ef04d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:13.918562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb7d570e5f942498a71bf5a53a84179', 'request_id': 'req-f0bc00b6-fe51-4808-9d6e-a979164b863a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.934003 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] The token cache is being invalidate because project 8eb7d570e5f942498a71bf5a53a84179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:13.934294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.934943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f0bc00b6-fe51-4808-9d6e-a979164b863a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:13.940599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1266/2511] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:13 2022] DELETE /identity/v3/projects/8eb7d570e5f942498a71bf5a53a84179 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:13.942390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebef24-6a0f-4a73-acf6-099b013675e2 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.942669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebef24-6a0f-4a73-acf6-099b013675e2 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.943431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebef24-6a0f-4a73-acf6-099b013675e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.965276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-88ebef24-6a0f-4a73-acf6-099b013675e2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:13.966514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88ebef24-6a0f-4a73-acf6-099b013675e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:13.980066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:13.980755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:13.980982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:13.981278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:13.981916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:13.984163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.004767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:14.011659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1246/2512] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:13 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:14.016356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.019270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:14.034112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93427da-d4ed-4f20-af29-6a857761c3d2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.038858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1267/2513] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:14.040345 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.041098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.041480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.041850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.042613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.045971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.047091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.047539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.047816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.063231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1247/2514] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:14.065092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.078504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d5f8-cb95-48a9-8b59-9de4f7c023c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.079159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:14.081017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:14.083630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.084314 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.084582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.084832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.085609 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.087238 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.089833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1268/2515] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:14.093813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.103911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1248/2516] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:14.104901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a97b6-410e-4c72-9a77-e0a5eaefe0c8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.108291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.110964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356864da-656d-44be-a668-0409915924f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.112040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356864da-656d-44be-a668-0409915924f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.112539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356864da-656d-44be-a668-0409915924f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.113045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356864da-656d-44be-a668-0409915924f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.114246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356864da-656d-44be-a668-0409915924f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:14.114810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356864da-656d-44be-a668-0409915924f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.116961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356864da-656d-44be-a668-0409915924f8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.121141 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aaef3-473e-41ce-b263-828df0c6561e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.126815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea251786-d6d3-4dbd-965d-edc21f332fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.127540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea251786-d6d3-4dbd-965d-edc21f332fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.127822 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea251786-d6d3-4dbd-965d-edc21f332fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.128187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea251786-d6d3-4dbd-965d-edc21f332fd7 admin admin] PATH_INFO: `/v3/projects/d62fc3d442db43509b84680be53ce716/users/9dc27a22d56e4e8e8d8a976c66d3e845/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.134686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1269/2517] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:14.138894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356864da-656d-44be-a668-0409915924f8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.146363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea251786-d6d3-4dbd-965d-edc21f332fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62fc3d442db43509b84680be53ce716, user_id=9dc27a22d56e4e8e8d8a976c66d3e845, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.149287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea251786-d6d3-4dbd-965d-edc21f332fd7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.152659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356864da-656d-44be-a668-0409915924f8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.159132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.159894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.160167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.160436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.161101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.163001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.165384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1249/2518] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:14 2022] PUT /identity/v3/projects/d62fc3d442db43509b84680be53ce716/users/9dc27a22d56e4e8e8d8a976c66d3e845/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:14.177810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.178093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.178461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.194132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1270/2519] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:14.199194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.215204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] MFA Rules not processed for user `9dc27a22d56e4e8e8d8a976c66d3e845`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:14.216339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:14.270543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1aef-f121-4773-ae34-d25085f42874 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.275444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.276046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.276320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.276589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.277252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.279252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.295284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1250/2520] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:14.305995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1271/2521] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:14.307001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.307818 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.309539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:14.319091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35ab4-5b26-4957-9f0a-306bac841636 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.321976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:14.324021 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.324636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.324947 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.325272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.325917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.328098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.340263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1251/2522] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:14.344455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.356667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdddc1-ced1-46ff-8288-2da6a7f38a61 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.361847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.363120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.363120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.363120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.364167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.366301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.378050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1252/2523] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:14.381957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.385221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe441f96-388f-4f9e-a302-63740c377f54 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.390992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdd030-2f12-4fda-978d-2c7baf37ba22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.391748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd030-2f12-4fda-978d-2c7baf37ba22 service glance] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.392093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd030-2f12-4fda-978d-2c7baf37ba22 service glance] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.392318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1000a-84a6-4616-8d3b-325402c9a108 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.392513 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdd030-2f12-4fda-978d-2c7baf37ba22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.397274 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.397925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.398206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.398486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] PATH_INFO: `/v3/projects/43ad76bde9204bc9868a55510d3359b8/users/9c917e8e736044ae8c54a643da0e11dc/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.402049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd030-2f12-4fda-978d-2c7baf37ba22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.403530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdd030-2f12-4fda-978d-2c7baf37ba22 service glance] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.413623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1272/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:14.418090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ad76bde9204bc9868a55510d3359b8, user_id=9c917e8e736044ae8c54a643da0e11dc, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.421015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.440743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1253/2525] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:14 2022] PUT /identity/v3/projects/43ad76bde9204bc9868a55510d3359b8/users/9c917e8e736044ae8c54a643da0e11dc/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:14.453453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.453585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.453781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.492999 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] MFA Rules not processed for user `9c917e8e736044ae8c54a643da0e11dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:14.494268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:14.567802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1273/2526] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:14.573204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.654680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:14.658872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79316481-6b86-4dbc-8546-c49051d76c71 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.665706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.666531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.666986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.667326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.668275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.670336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.706800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1254/2527] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:14.710102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.722723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952cd94-6aa6-44d7-a3b9-6fb6eb5a0e6e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.813506 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.814270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.814560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.814830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.815467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.817422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.845757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1274/2528] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:14 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:14.850773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.866862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb15d4-b4b8-471d-859a-34ae11c4c3c6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.872559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.873269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.874146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.874416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.874972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.876566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.893036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1255/2529] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:14.896173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:14.909697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b101f9f-a210-4402-bb43-32f234674b6c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:14.923901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:14.925052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:14.925557 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:14.928988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] PATH_INFO: `/v3/projects/a43c391dea5b4e2bad1a3937afc1c5f3/users/63d416f16ad044f4b7724ed48982296b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:14.964668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43c391dea5b4e2bad1a3937afc1c5f3, user_id=63d416f16ad044f4b7724ed48982296b, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:14.967450 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:14.999914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1275/2530] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:14 2022] PUT /identity/v3/projects/a43c391dea5b4e2bad1a3937afc1c5f3/users/63d416f16ad044f4b7724ed48982296b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:15.001394 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:15.023777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d4c5e-1a52-4946-bc20-29874fba297f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:15.101282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821815b6-06be-43bd-961f-ae9b436aac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:15.101885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821815b6-06be-43bd-961f-ae9b436aac6e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:15.102159 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821815b6-06be-43bd-961f-ae9b436aac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:15.102425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821815b6-06be-43bd-961f-ae9b436aac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:15.103055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821815b6-06be-43bd-961f-ae9b436aac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:15.104627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821815b6-06be-43bd-961f-ae9b436aac6e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:15.115937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1256/2531] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:15.120162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:15.131069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1523-fe64-42cc-bd15-82ea35a952f8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:15.151699 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:15.152377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:15.152649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:15.152953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] PATH_INFO: `/v3/projects/a43c391dea5b4e2bad1a3937afc1c5f3/users/63d416f16ad044f4b7724ed48982296b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:15.155659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43c391dea5b4e2bad1a3937afc1c5f3, user_id=63d416f16ad044f4b7724ed48982296b, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:15.158627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:15.161247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:15.173326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1276/2532] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:15 2022] PUT /identity/v3/projects/a43c391dea5b4e2bad1a3937afc1c5f3/users/63d416f16ad044f4b7724ed48982296b/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:15.185078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:15.185361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:15.185631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:15.216891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] MFA Rules not processed for user `63d416f16ad044f4b7724ed48982296b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:15.218778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:15.290381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1257/2533] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:15.302549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:15.304298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:15.369028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaaf6b-a9c7-459e-b59f-a554cc1f43de admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:15.372802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942448e-e1ef-4b1c-8fc1-6135d3348d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:15.374171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942448e-e1ef-4b1c-8fc1-6135d3348d53 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:15.374521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942448e-e1ef-4b1c-8fc1-6135d3348d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:15.374812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942448e-e1ef-4b1c-8fc1-6135d3348d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:15.385551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942448e-e1ef-4b1c-8fc1-6135d3348d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:15.387016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942448e-e1ef-4b1c-8fc1-6135d3348d53 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:15.397441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1277/2534] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:15.819363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:15.872692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:15.889269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fbe74-77b4-4852-a135-a8dd18e6e121 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:15.897857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:15.898502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:15.898777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:15.899046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] PATH_INFO: `/v3/users/9c917e8e736044ae8c54a643da0e11dc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:15.900176 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c917e8e736044ae8c54a643da0e11dc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:15.902120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:15.952237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c917e8e736044ae8c54a643da0e11dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:15.961712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c917e8e736044ae8c54a643da0e11dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:15.962458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c917e8e736044ae8c54a643da0e11dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:15.963228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c917e8e736044ae8c54a643da0e11dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:15.972999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c917e8e736044ae8c54a643da0e11dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.001449 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1258/2535] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:15 2022] DELETE /identity/v3/users/9c917e8e736044ae8c54a643da0e11dc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:16.003253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:16.003540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:16.003837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:16.024738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:16.026137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:16.107771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1278/2536] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:16.118512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:16.122874 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:16.189633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02fc3-e7af-4660-b1e6-211b507418cd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:16.203549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:16.203549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:16.203549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:16.203549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:16.227578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:16.229050 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:16.251985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1259/2537] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:16.549854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:16.552134 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:16.568280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22830a-ba55-4559-9dfb-5ace5d61297e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:16.574287 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:16.575089 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:16.575368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:16.575638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] PATH_INFO: `/v3/projects/43ad76bde9204bc9868a55510d3359b8` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:16.577473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ad76bde9204bc9868a55510d3359b8)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:16.579400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:16.629254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ad76bde9204bc9868a55510d3359b8', 'request_id': 'req-fa9fa981-6ac8-49ad-bafe-8947827eda68'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.635391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ad76bde9204bc9868a55510d3359b8', 'request_id': 'req-fa9fa981-6ac8-49ad-bafe-8947827eda68'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.642716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ad76bde9204bc9868a55510d3359b8', 'request_id': 'req-fa9fa981-6ac8-49ad-bafe-8947827eda68'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.665103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] The token cache is being invalidate because project 43ad76bde9204bc9868a55510d3359b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:16.665725 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.666664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.668354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1279/2538] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:16 2022] DELETE /identity/v3/projects/43ad76bde9204bc9868a55510d3359b8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:16.672489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:16.682071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89fdf-4eab-4d12-b8aa-be89ead8f7ec service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:16.741704 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:16.742340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:16.742630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:16.742903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] PATH_INFO: `/v3/users/63d416f16ad044f4b7724ed48982296b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:16.744012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d416f16ad044f4b7724ed48982296b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:16.745989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:16.761815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:16.792474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d416f16ad044f4b7724ed48982296b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.800994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d416f16ad044f4b7724ed48982296b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.801709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d416f16ad044f4b7724ed48982296b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.802306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d416f16ad044f4b7724ed48982296b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.812946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6a1d12b2-88bc-495f-a65f-f79ecfc985ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d416f16ad044f4b7724ed48982296b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:16.831970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1260/2539] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:16 2022] DELETE /identity/v3/users/63d416f16ad044f4b7724ed48982296b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:17.125649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.126882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:17.145915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fa981-6ac8-49ad-bafe-8947827eda68 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.173690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:17.221869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.222505 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.222779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.223045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] PATH_INFO: `/v3/projects/a43c391dea5b4e2bad1a3937afc1c5f3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.224156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43c391dea5b4e2bad1a3937afc1c5f3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.226303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.290748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43c391dea5b4e2bad1a3937afc1c5f3', 'request_id': 'req-316353c3-b785-4e02-812a-6727ff42206a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:17.297275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43c391dea5b4e2bad1a3937afc1c5f3', 'request_id': 'req-316353c3-b785-4e02-812a-6727ff42206a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:17.302917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43c391dea5b4e2bad1a3937afc1c5f3', 'request_id': 'req-316353c3-b785-4e02-812a-6727ff42206a'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:17.319064 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] The token cache is being invalidate because project a43c391dea5b4e2bad1a3937afc1c5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:17.319460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:17.320193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-316353c3-b785-4e02-812a-6727ff42206a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:17.321830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1280/2540] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:17 2022] DELETE /identity/v3/projects/a43c391dea5b4e2bad1a3937afc1c5f3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:17.331357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.332887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.334666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.363660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:17.365094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:17.427258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1261/2541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:17.436659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.437000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.437460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.459483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:17.460694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:17.470155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1281/2542] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:17.474381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.484084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dab16-e634-4c36-a4fe-5dbcf7640ef0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.488652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.489283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.489576 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.489833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.490473 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:17.490773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.492329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.507572 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1262/2543] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:17.511586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.522400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bac31-e7bb-4b9d-b2ca-f7a6c1d8dc51 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.527144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.527790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.528063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.528353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.529011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.531577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.564939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1282/2544] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:17 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:17.566545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.577706 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a306-d2a2-43ee-86d5-acf6ffc4d0ed admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.638667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.640089 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.640664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.641062 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.641794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.643775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.666500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1263/2545] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:17 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:17.670363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.681257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568907b0-cc78-4739-87ed-72a401fbe11c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.686898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.687611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.687887 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.688155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.688828 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.690405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.703078 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1283/2546] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:17.707038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.718170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026822cd-3bda-42e6-a675-4324bbf109fc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.723046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3c3ac-82d6-48a6-9640-18fb836d22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.723679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3c3ac-82d6-48a6-9640-18fb836d22dc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.724095 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3c3ac-82d6-48a6-9640-18fb836d22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.724372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3c3ac-82d6-48a6-9640-18fb836d22dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.725060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3c3ac-82d6-48a6-9640-18fb836d22dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.726746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3c3ac-82d6-48a6-9640-18fb836d22dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.733426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:17.746952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1264/2547] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:17.748853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.764540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62370c-7b93-4675-947b-29ad7ecf1f00 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:17.770543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:17.771631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.773461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.773461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] PATH_INFO: `/v3/projects/8176678dca324e6d95cd7a62d5e54957/users/ea2c3ad63661469fbc7b291e55af9d2e/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.788903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8176678dca324e6d95cd7a62d5e54957, user_id=ea2c3ad63661469fbc7b291e55af9d2e, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:17.791539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:17.815008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1284/2548] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:17 2022] PUT /identity/v3/projects/8176678dca324e6d95cd7a62d5e54957/users/ea2c3ad63661469fbc7b291e55af9d2e/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:17.825803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:17.826088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:17.826380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:17.857049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] MFA Rules not processed for user `ea2c3ad63661469fbc7b291e55af9d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:17.858308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:17.928336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1265/2549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:17.929522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:17.977797 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:17.994381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000720c-e582-4e96-842c-3fa03d5d6a85 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.000305 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.000960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.001263 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.001535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.002214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.004157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.031085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1285/2550] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:17 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:18.035215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.046950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6286ee-1ce6-42e2-8919-bea7de72c063 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.111161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.111786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.112068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.112336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.113147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.115224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.143695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1266/2551] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:18 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:18.147825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.194645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b0c7-89ac-49d6-aaaf-5d0007130501 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.200462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.201132 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.201900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.202232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.203184 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.204813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.216199 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1286/2552] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:18.221767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.235263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6754-2ec8-45b0-b257-7006f764ccfe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.241642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.242333 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.242612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.242923 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] PATH_INFO: `/v3/projects/af42736c2cf440a5a9b8d85916d8c106/users/a4dd1991db464adaacf376d356935025/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.276871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af42736c2cf440a5a9b8d85916d8c106, user_id=a4dd1991db464adaacf376d356935025, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.280444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.333074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1267/2553] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:18 2022] PUT /identity/v3/projects/af42736c2cf440a5a9b8d85916d8c106/users/a4dd1991db464adaacf376d356935025/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:18.336765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.356960 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c00f-f3bb-49d3-b54b-33dcc55ce492 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.441368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d7b94-02ed-466a-bcc9-32f2a2653458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.442144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7b94-02ed-466a-bcc9-32f2a2653458 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.442481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7b94-02ed-466a-bcc9-32f2a2653458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.442762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7b94-02ed-466a-bcc9-32f2a2653458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.443502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d7b94-02ed-466a-bcc9-32f2a2653458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.451166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d7b94-02ed-466a-bcc9-32f2a2653458 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.468902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1287/2554] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:18.472909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.486076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1303d63-d2ea-4261-83df-699dcf0f3de3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.491396 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.492125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.492470 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.492826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] PATH_INFO: `/v3/projects/af42736c2cf440a5a9b8d85916d8c106/users/a4dd1991db464adaacf376d356935025/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.495500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af42736c2cf440a5a9b8d85916d8c106, user_id=a4dd1991db464adaacf376d356935025, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.499662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.512302 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1268/2555] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:18 2022] PUT /identity/v3/projects/af42736c2cf440a5a9b8d85916d8c106/users/a4dd1991db464adaacf376d356935025/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:18.534483 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.534857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.535238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.567426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] MFA Rules not processed for user `a4dd1991db464adaacf376d356935025`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:18.568614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:18.647621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1288/2556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:18.659037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.660703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:18.708073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:18.721093 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c3b5a-9c7c-4c9a-8c5f-2ff26d532d62 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.725298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a7f56-6721-40d1-b88d-e86528023a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.725910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7f56-6721-40d1-b88d-e86528023a31 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.726186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7f56-6721-40d1-b88d-e86528023a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.726569 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a7f56-6721-40d1-b88d-e86528023a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.737708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7f56-6721-40d1-b88d-e86528023a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.739126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a7f56-6721-40d1-b88d-e86528023a31 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.749429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1269/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:18.819293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:18.866076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:18.885079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72126f-9000-4d08-85d3-713a0932a684 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:18.890394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:18.891011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.891283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.891546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] PATH_INFO: `/v3/users/ea2c3ad63661469fbc7b291e55af9d2e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:18.893039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2c3ad63661469fbc7b291e55af9d2e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:18.895081 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:18.947858 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2c3ad63661469fbc7b291e55af9d2e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:18.948421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2c3ad63661469fbc7b291e55af9d2e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:18.949044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2c3ad63661469fbc7b291e55af9d2e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:18.958169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2c3ad63661469fbc7b291e55af9d2e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:18.965726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2c3ad63661469fbc7b291e55af9d2e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:18.984176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1289/2558] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:18 2022] DELETE /identity/v3/users/ea2c3ad63661469fbc7b291e55af9d2e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:18.990096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:18.990424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:18.990867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:19.016214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:19.017490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:19.084835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1270/2559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:19.100680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:19.102248 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:19.162206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84adeaa-7a42-4d4f-b4ff-04fa40534bbc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:19.165977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:19.166586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:19.166861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:19.167158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:19.179232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:19.180759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:19.192049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1290/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:19.479099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:19.480599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:19.493915 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8e3ff-3758-449b-a08c-cb957c8c55dd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:19.499310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:19.499983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:19.500259 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:19.500528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] PATH_INFO: `/v3/projects/8176678dca324e6d95cd7a62d5e54957` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:19.501785 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8176678dca324e6d95cd7a62d5e54957)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:19.503776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:19.554685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8176678dca324e6d95cd7a62d5e54957', 'request_id': 'req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.563074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8176678dca324e6d95cd7a62d5e54957', 'request_id': 'req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.569701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8176678dca324e6d95cd7a62d5e54957', 'request_id': 'req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.581546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] The token cache is being invalidate because project 8176678dca324e6d95cd7a62d5e54957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:19.581958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.582639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.584154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1271/2561] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:19 2022] DELETE /identity/v3/projects/8176678dca324e6d95cd7a62d5e54957 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:19.589629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:19.607461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550168e-9c37-43d8-9493-7dcd904b12cb service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:19.666737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:19.667366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:19.667643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:19.667914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] PATH_INFO: `/v3/users/a4dd1991db464adaacf376d356935025` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:19.669074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dd1991db464adaacf376d356935025)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:19.671094 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:19.678923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:19.727824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dd1991db464adaacf376d356935025'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.728387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dd1991db464adaacf376d356935025'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.729014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dd1991db464adaacf376d356935025'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.736409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dd1991db464adaacf376d356935025'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.743603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-df05068a-e6ef-465f-b24b-2ae26970d0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dd1991db464adaacf376d356935025'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:19.761281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1291/2562] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:19 2022] DELETE /identity/v3/users/a4dd1991db464adaacf376d356935025 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:20.038409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.039807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:20.054130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e9cd7-ee14-45e3-88af-e5df65d7cd97 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.120898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.121567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.121821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.122087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] PATH_INFO: `/v3/projects/af42736c2cf440a5a9b8d85916d8c106` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.123260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af42736c2cf440a5a9b8d85916d8c106)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.125423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.138304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:20.189097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af42736c2cf440a5a9b8d85916d8c106', 'request_id': 'req-0707a7e5-fa66-433f-a38d-0d691e64493a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:20.196894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af42736c2cf440a5a9b8d85916d8c106', 'request_id': 'req-0707a7e5-fa66-433f-a38d-0d691e64493a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:20.204452 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af42736c2cf440a5a9b8d85916d8c106', 'request_id': 'req-0707a7e5-fa66-433f-a38d-0d691e64493a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:20.215954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] The token cache is being invalidate because project af42736c2cf440a5a9b8d85916d8c106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:20.216421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:20.218032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0707a7e5-fa66-433f-a38d-0d691e64493a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:20.219842 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1272/2563] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:20 2022] DELETE /identity/v3/projects/af42736c2cf440a5a9b8d85916d8c106 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:20.224618 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.224939 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.225211 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.246808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:20.248278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:20.325799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1292/2564] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:20.328429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.328738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.329045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.354500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:20.355703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:20.363685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1273/2565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:20.367880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.377836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269b168-a935-43ca-a08f-09a0a2d515e0 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.382360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.382982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.383255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.383523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.384166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:20.384470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.386103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.399692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1293/2566] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:20.405067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.414955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24a4e8-9a1f-49e3-9e30-b87a26a32335 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.419561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.420244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.420486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.420717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.421385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.423275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.449487 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1274/2567] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:20.454222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.464318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98230cf-bdd1-4186-a67d-203f36365010 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.523275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.523788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.524062 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.524328 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.524970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.526873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.542511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:20.549103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1294/2568] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:20.557202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.565163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d1c5-3672-4d9f-bb8c-e640f8b2584a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.569815 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.570435 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.570707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.570970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.571633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.573510 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.584328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1275/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:20.588366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.598686 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58775b-42ea-4c9b-ba02-f987ed0c7716 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.603791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f2028-2e4f-4e15-96e3-d6caa32d528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.604390 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f2028-2e4f-4e15-96e3-d6caa32d528e admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.604671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f2028-2e4f-4e15-96e3-d6caa32d528e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.604979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f2028-2e4f-4e15-96e3-d6caa32d528e admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.605632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f2028-2e4f-4e15-96e3-d6caa32d528e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.607256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f2028-2e4f-4e15-96e3-d6caa32d528e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.618624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1295/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:20.623415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.635138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166e531-5311-4cd0-ae3c-f6e19f60d565 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.640032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.640681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.640990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.641285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] PATH_INFO: `/v3/projects/258d7174e9ff435f9cf0b670b34c1e2a/users/6d90d34eb76548f7932fbd6abb4b941b/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.656727 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258d7174e9ff435f9cf0b670b34c1e2a, user_id=6d90d34eb76548f7932fbd6abb4b941b, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.659417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.672695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1276/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:20 2022] PUT /identity/v3/projects/258d7174e9ff435f9cf0b670b34c1e2a/users/6d90d34eb76548f7932fbd6abb4b941b/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:20.682822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698546bf-f3ec-4123-b67e-56643b558705 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.683106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698546bf-f3ec-4123-b67e-56643b558705 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.683373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698546bf-f3ec-4123-b67e-56643b558705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.713976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-698546bf-f3ec-4123-b67e-56643b558705 None None] MFA Rules not processed for user `6d90d34eb76548f7932fbd6abb4b941b`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:20.715172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-698546bf-f3ec-4123-b67e-56643b558705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:20.791559 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1296/2572] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:20.800821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.871910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.872189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.872457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.885694 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd769d2-4b7c-4c18-88c4-098f1869c2f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:20.894240 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:20.894860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:20.895168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:20.895438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:20.896065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:20.898155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:20.901135 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:20.913070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:20.930397 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1277/2573] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:20.931418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.956752 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:20.977143 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1297/2574] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:20.990577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:20.991927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:21.000717 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7320820-6df6-4915-9ba5-47adb1956807 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.005400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.006002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.006278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.006550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.007197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.009206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.033755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1278/2575] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:20 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:21.037654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:21.047566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7181bc-97fc-45a5-b8ec-61f7e7aefcf3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.052270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.052922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.053199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.053490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.054126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.055796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.065740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a615719-7e11-4d9f-9a88-edab38e21344 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.067383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1279/2576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:21.071269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:21.082232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92613507-da94-4ac7-bbab-73a44d57470a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.093366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.094041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.094318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.094588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] PATH_INFO: `/v3/projects/36024cb104de418fae50bed9da8679e7/users/a8e1e37c24fc4e6ea4184ea437078183/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.095188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:21.111061 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36024cb104de418fae50bed9da8679e7, user_id=a8e1e37c24fc4e6ea4184ea437078183, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.113734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.126477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1280/2577] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:21 2022] PUT /identity/v3/projects/36024cb104de418fae50bed9da8679e7/users/a8e1e37c24fc4e6ea4184ea437078183/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:21.130382 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:21.132740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.133376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.133654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.133924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.206690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ea98d-cf2b-4971-af9d-6ccfb1edb0f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.211950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.212584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.212918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.213217 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.213872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.215499 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.227027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1281/2578] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:21.231753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:21.245714 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63bb51-d205-404f-b373-77c9d003ed06 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.250658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ad039-a6af-4142-b30b-088dc3911202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.251337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad039-a6af-4142-b30b-088dc3911202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.251614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad039-a6af-4142-b30b-088dc3911202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.251914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad039-a6af-4142-b30b-088dc3911202 admin admin] PATH_INFO: `/v3/projects/36024cb104de418fae50bed9da8679e7/users/a8e1e37c24fc4e6ea4184ea437078183/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.253984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ad039-a6af-4142-b30b-088dc3911202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36024cb104de418fae50bed9da8679e7, user_id=a8e1e37c24fc4e6ea4184ea437078183, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.256642 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ad039-a6af-4142-b30b-088dc3911202 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.269051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1282/2579] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:21 2022] PUT /identity/v3/projects/36024cb104de418fae50bed9da8679e7/users/a8e1e37c24fc4e6ea4184ea437078183/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:21.280838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.281179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.281429 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.310216 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] MFA Rules not processed for user `a8e1e37c24fc4e6ea4184ea437078183`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:21.311556 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:21.316928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.318719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.332649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1298/2580] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 12:29:21.364109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:21.409517 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1283/2581] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:21.417997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:21.419386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:21.483660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bebe8-c444-47b1-bc80-19c90bd2b434 service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.554881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.556429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.556561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.556868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.572888 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.574270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.587083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1299/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:21.663951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:21.665977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:21.681448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893c38-3555-40b6-964c-574b52f3f0d2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:21.686950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2072b7-516e-4a81-a514-1abe607aed20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:21.687684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2072b7-516e-4a81-a514-1abe607aed20 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:21.687849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2072b7-516e-4a81-a514-1abe607aed20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:21.688121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2072b7-516e-4a81-a514-1abe607aed20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:21.751847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2072b7-516e-4a81-a514-1abe607aed20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:21.753423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2072b7-516e-4a81-a514-1abe607aed20 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:21.765627 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1284/2583] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:25.344403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:25.375172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:25.409144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efa4c-ebce-4a2d-ade7-fdf39854a626 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:25.413928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:25.414824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:25.415126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:25.415502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] PATH_INFO: `/v3/users/6d90d34eb76548f7932fbd6abb4b941b` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:25.416963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d90d34eb76548f7932fbd6abb4b941b)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:25.419074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:25.467316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d90d34eb76548f7932fbd6abb4b941b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:25.467955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d90d34eb76548f7932fbd6abb4b941b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:25.468650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d90d34eb76548f7932fbd6abb4b941b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:25.476606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d90d34eb76548f7932fbd6abb4b941b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:25.483945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d90d34eb76548f7932fbd6abb4b941b'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:25.502239 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1300/2584] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:25 2022] DELETE /identity/v3/users/6d90d34eb76548f7932fbd6abb4b941b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:25.506721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:25.507204 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:25.507317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:25.526183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:25.527401 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:25.588066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1285/2585] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:25.598154 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:25.599563 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:25.659334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095240-1968-463b-8a63-3bb5bc7c4e53 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:25.662935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:25.663532 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:25.663806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:25.664074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:25.674036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:25.675309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:25.684992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1301/2586] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:25.985500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:25.987346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:26.000666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3bee3-5ba5-4ff6-8f97-6a0e0aa3cefc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:26.005726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:26.006427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.006848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.007114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] PATH_INFO: `/v3/projects/258d7174e9ff435f9cf0b670b34c1e2a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.008414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258d7174e9ff435f9cf0b670b34c1e2a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:26.010365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:26.058849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258d7174e9ff435f9cf0b670b34c1e2a', 'request_id': 'req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.065518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258d7174e9ff435f9cf0b670b34c1e2a', 'request_id': 'req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.072393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258d7174e9ff435f9cf0b670b34c1e2a', 'request_id': 'req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.083277 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] The token cache is being invalidate because project 258d7174e9ff435f9cf0b670b34c1e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:26.083559 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.084192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.085726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1286/2587] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:25 2022] DELETE /identity/v3/projects/258d7174e9ff435f9cf0b670b34c1e2a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:26.089759 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:26.100361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e298d-0777-499a-859b-b880a44644a3 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:26.144799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:26.157867 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:26.158485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.158758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.159023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] PATH_INFO: `/v3/users/a8e1e37c24fc4e6ea4184ea437078183` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.160116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e1e37c24fc4e6ea4184ea437078183)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:26.162066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:26.206487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e1e37c24fc4e6ea4184ea437078183'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.207042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e1e37c24fc4e6ea4184ea437078183'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.207634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e1e37c24fc4e6ea4184ea437078183'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.214882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e1e37c24fc4e6ea4184ea437078183'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.222157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-e1b97794-6c62-4bf4-b767-9946581e51b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e1e37c24fc4e6ea4184ea437078183'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.239806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1302/2588] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:26 2022] DELETE /identity/v3/users/a8e1e37c24fc4e6ea4184ea437078183 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:26.502186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:26.503732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:26.513518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:26.518603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fbbd5-fc04-43c4-9f48-4d0712bc5b24 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:26.577143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:26.577777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.578056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.578327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] PATH_INFO: `/v3/projects/36024cb104de418fae50bed9da8679e7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.579433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36024cb104de418fae50bed9da8679e7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:26.581370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:26.628010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36024cb104de418fae50bed9da8679e7', 'request_id': 'req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.635253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36024cb104de418fae50bed9da8679e7', 'request_id': 'req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.641775 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36024cb104de418fae50bed9da8679e7', 'request_id': 'req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.653677 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] The token cache is being invalidate because project 36024cb104de418fae50bed9da8679e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:26.654528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.655525 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-687c3de6-0d4e-4d16-9aa7-d2f849520e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:26.657100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1287/2589] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:26 2022] DELETE /identity/v3/projects/36024cb104de418fae50bed9da8679e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:26.663002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.663002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.664114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.687775 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:26.688929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:26.747490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1303/2590] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:26.755219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.755507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.755776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.775178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:26.776373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:26.785437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1288/2591] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:26.789883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:26.800207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0a12-a91c-44a2-8541-fbadd94a1ae7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:26.804988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:26.805727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.806015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.806284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.807038 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:26.807219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:26.808825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:26.820916 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1304/2592] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:26.825680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:26.834840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c81bc7-71ad-45c3-a6b0-0b36a1f01294 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:26.840010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:26.840597 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.840910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.841183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.842372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:26.844276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:26.871746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1289/2593] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:26 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:26.876166 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:26.885951 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900ba8-4e62-4a23-be43-8afc0eeec074 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:26.944212 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:26.951180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:26.952055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:26.952501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:26.952972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:26.954187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:26.956238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:26.980444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1305/2594] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:26 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:26.986042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:26.996573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8a1e0-9e2b-42d0-8419-a43646e651c6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:27.005162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:27.005767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:27.006040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:27.006306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:27.006944 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:27.008498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:27.020810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1290/2595] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:27.023817 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:27.035142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cea5-4a3e-4cd9-a355-1cd62e86ac11 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:27.043357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707216f-42dc-4ed9-b07e-78cdbb322764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:27.043956 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707216f-42dc-4ed9-b07e-78cdbb322764 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:27.044234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707216f-42dc-4ed9-b07e-78cdbb322764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:27.044499 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707216f-42dc-4ed9-b07e-78cdbb322764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:27.045252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707216f-42dc-4ed9-b07e-78cdbb322764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:27.046864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707216f-42dc-4ed9-b07e-78cdbb322764 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:27.057649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1306/2596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:27.062010 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:27.074083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5b9a-ad2b-40ef-a84c-fee609d9d55c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:27.077808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:27.078453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:27.078729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:27.078998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] PATH_INFO: `/v3/projects/67c13f4b01b6440d9d184346d11ec7ff/users/6661ed17eef94eaebd0761448a0758e4/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:27.094749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c13f4b01b6440d9d184346d11ec7ff, user_id=6661ed17eef94eaebd0761448a0758e4, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:27.097412 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:27.114129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1291/2597] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:27 2022] PUT /identity/v3/projects/67c13f4b01b6440d9d184346d11ec7ff/users/6661ed17eef94eaebd0761448a0758e4/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:27.119520 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6521-452a-4dbc-b935-b64f98962d85 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:27.119802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6521-452a-4dbc-b935-b64f98962d85 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:27.120073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6521-452a-4dbc-b935-b64f98962d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:27.141264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-cede6521-452a-4dbc-b935-b64f98962d85 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:27.142444 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-cede6521-452a-4dbc-b935-b64f98962d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:27.209349 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1307/2598] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:27.220260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:27.221959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:27.257825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:27.283868 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fb2d-812e-4f49-a8eb-964bc52f6fb8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:27.287656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:27.288294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:27.288626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:27.288937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:27.299561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:27.301163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:27.311990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1292/2599] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:27.961012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:27.961492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:27.961596 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:27.994536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] MFA Rules not processed for user `6661ed17eef94eaebd0761448a0758e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:27.996193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:28.077636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1308/2600] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:28.079350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.090819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937368b9-9a1e-4c41-b22b-401deebef0d1 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.100309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.101013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.101301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.101571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.102326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.104599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.139468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1293/2601] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:28 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:28.143741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.158111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5daa7-8420-415d-86dc-5486fb52eb87 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.221853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.222466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.222738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.223004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.223934 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.225679 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.236786 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:28.250733 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1309/2602] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:28 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:28.259310 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.270746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8ca97-c69a-4285-a748-e4c12e6a9ef3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.276016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.276686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.277068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.277443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.278065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.279909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.296202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.297220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1294/2603] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:28.303439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.305777 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:28.308069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c3b-69a1-4ac3-90f5-2f05ceec4716 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.313933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.314660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.314850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.315113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] PATH_INFO: `/v3/projects/6cedf282b9874c958ecaa6aa8ecb1381/users/0b2d27965fb14ec98d7397a90d123464/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.331005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cedf282b9874c958ecaa6aa8ecb1381, user_id=0b2d27965fb14ec98d7397a90d123464, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.333668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.347621 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1310/2604] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:28 2022] PUT /identity/v3/projects/6cedf282b9874c958ecaa6aa8ecb1381/users/0b2d27965fb14ec98d7397a90d123464/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:28.351556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.366803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606dd92-b75c-4469-89cf-29ca16c83f67 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.414562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40ed8-1b9f-4dfe-9dee-a5d64bfd80d5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.416577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.417346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.417731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.418104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.419342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.420123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.420355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:28.420522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.420676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.421806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.423391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.432504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.433536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1311/2605] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:28.437251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec41c2-301f-463c-a340-f50b826c93e9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.438254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:28.447814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53f1f8-95f5-42a2-bc67-5bf4d6808a0c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:28.448825 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1295/2606] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:28.453581 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4985-6a76-4716-9829-6f0f17f60a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:28.454223 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4985-6a76-4716-9829-6f0f17f60a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:28.454500 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4985-6a76-4716-9829-6f0f17f60a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:28.454770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4985-6a76-4716-9829-6f0f17f60a19 admin admin] PATH_INFO: `/v3/projects/6cedf282b9874c958ecaa6aa8ecb1381/users/0b2d27965fb14ec98d7397a90d123464/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:28.456673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd4985-6a76-4716-9829-6f0f17f60a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cedf282b9874c958ecaa6aa8ecb1381, user_id=0b2d27965fb14ec98d7397a90d123464, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:28.459359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd4985-6a76-4716-9829-6f0f17f60a19 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:28.470550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1312/2607] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:28 2022] PUT /identity/v3/projects/6cedf282b9874c958ecaa6aa8ecb1381/users/0b2d27965fb14ec98d7397a90d123464/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:29.124881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:29.125356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:29.125456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:29.155029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] MFA Rules not processed for user `0b2d27965fb14ec98d7397a90d123464`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:29.156301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:29.225331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:29.262848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1296/2608] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:29.276139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:29.276613 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:29.276736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:29.313017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] MFA Rules not processed for user `6661ed17eef94eaebd0761448a0758e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:29.315115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:29.392974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1313/2609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:29.401808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:29.403416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:29.491502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d9d1e-2c7f-488d-9449-d3b8f91fe2aa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:29.504245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:29.504999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:29.505343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:29.505755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:29.515567 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:29.517616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:29.528168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1297/2610] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:29.948957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:30.009848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2b8b8-bce4-4323-8c2a-2beeba0038ed None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:30.014039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:30.014787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:30.015073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:30.015335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:30.017116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:30.027063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:30.028485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:30.033752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:30.038253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1314/2611] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:32.628763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:32.630235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:32.713470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:32.714919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:32.724002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48e84-bf47-4ed7-bca8-dd12f73e85ba service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:32.729904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:32.730811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:32.730811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:32.731207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:32.735321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:32.750558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:32.752343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:32.764965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1298/2612] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:32.796936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701cec-f8dd-4768-893d-cbec9a2c0093 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:32.805703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:32.806352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:32.806635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:32.809014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] PATH_INFO: `/v3/users/6ebfeba30aa342a99e0d5855f9ac8f12` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:32.811057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebfeba30aa342a99e0d5855f9ac8f12)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:32.813227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:32.868004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebfeba30aa342a99e0d5855f9ac8f12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:32.868658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebfeba30aa342a99e0d5855f9ac8f12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:32.869816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebfeba30aa342a99e0d5855f9ac8f12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:32.877386 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebfeba30aa342a99e0d5855f9ac8f12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:32.886183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-6fde7172-eb0f-4840-8843-4f68369c3bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebfeba30aa342a99e0d5855f9ac8f12'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:32.907968 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1315/2613] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:32 2022] DELETE /identity/v3/users/6ebfeba30aa342a99e0d5855f9ac8f12 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:33.131045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.148907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef20d-a258-4d26-8b05-161e811767f3 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.228588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.229442 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.229732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.230201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] PATH_INFO: `/v3/projects/41b959b4494c4d949ae97f84299ad9d2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.231594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b959b4494c4d949ae97f84299ad9d2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.234080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.237303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.299951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b959b4494c4d949ae97f84299ad9d2', 'request_id': 'req-058341e3-ba8d-4238-8060-e19c27eaf7b9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:33.308443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b959b4494c4d949ae97f84299ad9d2', 'request_id': 'req-058341e3-ba8d-4238-8060-e19c27eaf7b9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:33.315650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b959b4494c4d949ae97f84299ad9d2', 'request_id': 'req-058341e3-ba8d-4238-8060-e19c27eaf7b9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:33.326793 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] The token cache is being invalidate because project 41b959b4494c4d949ae97f84299ad9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:33.327080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:33.327728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-058341e3-ba8d-4238-8060-e19c27eaf7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:33.329257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1299/2614] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:33 2022] DELETE /identity/v3/projects/41b959b4494c4d949ae97f84299ad9d2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:33.334261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.334537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.334800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.354981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:33.356319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:33.418147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1316/2615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:33.426294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.426577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.426847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.447252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:33.448800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:33.458545 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1300/2616] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:33.462675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.473019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b311a3-a721-467a-a932-b199d861fe97 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.479607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.480718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.480994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.481409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.482346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:33.482626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.484443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.504192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.505107 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1317/2617] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:33.518858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937eaa9-7e65-42cf-9dd8-791e415dabf9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.524800 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.525736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.526051 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.526323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.527440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.530937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.579956 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1301/2618] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:33 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:33.584688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.597459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faade8c-ceb0-48a8-b8c0-19692e635cab admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.602319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.675652 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.676343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.676622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.676921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.677690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.679739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.703495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1318/2619] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:33 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:33.707745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.718437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27245e1f-dde9-4dab-816c-30fddbf85c23 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.723626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.724359 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.724846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.725131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.725764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.727557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.738631 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1302/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:33.743234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.755787 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1285ef7-545b-4df6-a287-538336770eec admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.760819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505d74-4037-4aac-a8a3-1db206976372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.761415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505d74-4037-4aac-a8a3-1db206976372 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.761742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505d74-4037-4aac-a8a3-1db206976372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.762019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505d74-4037-4aac-a8a3-1db206976372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.762675 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505d74-4037-4aac-a8a3-1db206976372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.764318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505d74-4037-4aac-a8a3-1db206976372 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.775460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1319/2621] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:33.780035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.792038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f002fcb-bbfa-4057-afe1-09ebc4858e78 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:33.798582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:33.799218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.799497 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.799772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] PATH_INFO: `/v3/projects/811f651b2ad443d1b0b08ae682f60972/users/fd68bfaa143a4c3bbc7b45fcdd7fcc52/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.816589 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811f651b2ad443d1b0b08ae682f60972, user_id=fd68bfaa143a4c3bbc7b45fcdd7fcc52, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:33.819271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:33.834685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1303/2622] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:33 2022] PUT /identity/v3/projects/811f651b2ad443d1b0b08ae682f60972/users/fd68bfaa143a4c3bbc7b45fcdd7fcc52/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:33.845019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:33.845293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:33.845554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:33.874944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] MFA Rules not processed for user `fd68bfaa143a4c3bbc7b45fcdd7fcc52`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:33.876133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:33.943820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1320/2623] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:33.957925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:33.959735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:34.033138 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda486b-f35a-4cc1-a0c0-711ee3ca4fc7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:34.038696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53a90a-6221-48ee-a555-17f7dfa3f761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:34.039272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53a90a-6221-48ee-a555-17f7dfa3f761 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:34.039546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53a90a-6221-48ee-a555-17f7dfa3f761 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:34.039811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53a90a-6221-48ee-a555-17f7dfa3f761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:34.050805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53a90a-6221-48ee-a555-17f7dfa3f761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:34.052406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53a90a-6221-48ee-a555-17f7dfa3f761 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:34.061925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1304/2624] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:36.735696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:36.793131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc37b-61fe-4da6-a725-d2f8accb3e4d None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:36.798162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:36.798810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:36.799088 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:36.799353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] PATH_INFO: `/v3/users/fd68bfaa143a4c3bbc7b45fcdd7fcc52` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:36.800461 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd68bfaa143a4c3bbc7b45fcdd7fcc52)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:36.802411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:36.818522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:36.851987 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd68bfaa143a4c3bbc7b45fcdd7fcc52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:36.852617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd68bfaa143a4c3bbc7b45fcdd7fcc52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:36.853243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd68bfaa143a4c3bbc7b45fcdd7fcc52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:36.860416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd68bfaa143a4c3bbc7b45fcdd7fcc52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:36.867093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd68bfaa143a4c3bbc7b45fcdd7fcc52'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:36.884010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1321/2625] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:36 2022] DELETE /identity/v3/users/fd68bfaa143a4c3bbc7b45fcdd7fcc52 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:36.890172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:36.890644 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:36.890744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:36.910347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:36.911541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:36.916578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:36.947400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:36.948884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:36.982284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1305/2626] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:36.991738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:36.993208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.032445 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11678874-8c24-4228-80d9-567e531569e0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.038019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.038645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.038914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.039189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] PATH_INFO: `/v3/users/9dc27a22d56e4e8e8d8a976c66d3e845` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.040314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc27a22d56e4e8e8d8a976c66d3e845)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.042439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.057215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af0bad-c8aa-4608-99d0-0bf09a2ce35d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.060812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0e561-f506-45c1-b930-0cae179f9374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.061427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e561-f506-45c1-b930-0cae179f9374 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.061703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e561-f506-45c1-b930-0cae179f9374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.061969 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e561-f506-45c1-b930-0cae179f9374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.073919 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0e561-f506-45c1-b930-0cae179f9374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.076827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0e561-f506-45c1-b930-0cae179f9374 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.087701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1306/2627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:29:37.101697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc27a22d56e4e8e8d8a976c66d3e845'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.102456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc27a22d56e4e8e8d8a976c66d3e845'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.103155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc27a22d56e4e8e8d8a976c66d3e845'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.113847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc27a22d56e4e8e8d8a976c66d3e845'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.123187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc27a22d56e4e8e8d8a976c66d3e845'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.145810 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1322/2628] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:36 2022] DELETE /identity/v3/users/9dc27a22d56e4e8e8d8a976c66d3e845 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:37.150253 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.150542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.150819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.174116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:37.175246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.243726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1307/2629] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:37.259504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.261179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.284688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:37.344416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802d68-d7b5-454c-ba25-76c4d3860b26 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.349119 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa68dd-2a14-40b3-9bdd-bcd9906b9678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.350005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa68dd-2a14-40b3-9bdd-bcd9906b9678 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.350275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa68dd-2a14-40b3-9bdd-bcd9906b9678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.350548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa68dd-2a14-40b3-9bdd-bcd9906b9678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.361870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa68dd-2a14-40b3-9bdd-bcd9906b9678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.363304 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa68dd-2a14-40b3-9bdd-bcd9906b9678 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.380109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1323/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:37.416246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.419330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.432161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18b74f-8207-4c4d-ba86-667f4bc24309 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.438248 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.438995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.439275 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.439695 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] PATH_INFO: `/v3/projects/811f651b2ad443d1b0b08ae682f60972` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.440789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=811f651b2ad443d1b0b08ae682f60972)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.442985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.501209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811f651b2ad443d1b0b08ae682f60972', 'request_id': 'req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.503001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:37.510691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811f651b2ad443d1b0b08ae682f60972', 'request_id': 'req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.518788 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811f651b2ad443d1b0b08ae682f60972', 'request_id': 'req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.533137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] The token cache is being invalidate because project 811f651b2ad443d1b0b08ae682f60972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:37.533406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.534711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ad74f68-aaf5-42b4-9f0a-f6f55fc0acfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:37.536453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1308/2631] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:37 2022] DELETE /identity/v3/projects/811f651b2ad443d1b0b08ae682f60972 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:37.541205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.541814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.541942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.570654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:37.572330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.650862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1324/2632] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:37.660462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.660806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.661060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.683867 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:37.686304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.694891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1309/2633] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:37.699519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.710308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd2fb-c62c-4fae-8942-f5601656ffc7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.715322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.717057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.717257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.717892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.718313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:37.718616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.720195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.732625 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1325/2634] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:37.737767 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.747461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a60437-d3fb-4d98-b90d-01366a7c2ed4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.752425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.753060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.753336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.753602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.754215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.756092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.804836 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1310/2635] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:37 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:37.806484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.822859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240f8c-0085-47e4-ba15-a10e82251a54 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.849684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.851921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.908582 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.909477 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.909823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.910784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.911000 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.913165 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.942929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1326/2636] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:37 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:37.943928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:37.945767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:37.955214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46dd77-96ee-4fb5-afc8-68ddf97d2bcc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:37.968073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:37.968895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:37.969236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:37.969619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] PATH_INFO: `/v3/projects/d62fc3d442db43509b84680be53ce716` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:37.972142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62fc3d442db43509b84680be53ce716)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:37.976380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:37.994191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:38.045693 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62fc3d442db43509b84680be53ce716', 'request_id': 'req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:38.060447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62fc3d442db43509b84680be53ce716', 'request_id': 'req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:38.069218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62fc3d442db43509b84680be53ce716', 'request_id': 'req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:38.079412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6714751-429a-4577-99e1-1279fd908759 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.084828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] The token cache is being invalidate because project d62fc3d442db43509b84680be53ce716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:38.086015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:38.087123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:38.101872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1311/2637] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:37 2022] DELETE /identity/v3/projects/d62fc3d442db43509b84680be53ce716 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:38.103375 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.118218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:38.241640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:38.243164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e487f1b5af4aa0a2d922d374adc29f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.244065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.244392 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.244976 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.247336 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:38.270120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.271784 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.286512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1327/2638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:38.296997 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707aa9e-a671-42ad-bc9f-1c1ad2a1ebd3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.303952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.304675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.304989 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.305256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.305912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.307662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.332436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1312/2639] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:38.333057 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.345033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc127d0-ef5e-4584-8be2-1cba7371ed7d service nova] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.349910 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9eb3d-be7d-4bdf-a8d2-106ec750d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.350529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9eb3d-be7d-4bdf-a8d2-106ec750d11b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.350807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9eb3d-be7d-4bdf-a8d2-106ec750d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.351075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9eb3d-be7d-4bdf-a8d2-106ec750d11b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.351726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9eb3d-be7d-4bdf-a8d2-106ec750d11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.353561 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9eb3d-be7d-4bdf-a8d2-106ec750d11b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.365893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1328/2640] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:38.370369 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.383735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c22c3-98ae-48f4-a4f5-182d2a871e16 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.388331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.389207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.389484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.389753 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] PATH_INFO: `/v3/projects/5ed9f3d236f84041aa51412c6458adf8/users/fc5bf48faf4041f08f69dfce42e10a03/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.405027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed9f3d236f84041aa51412c6458adf8, user_id=fc5bf48faf4041f08f69dfce42e10a03, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.408281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.422232 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1313/2641] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:38 2022] PUT /identity/v3/projects/5ed9f3d236f84041aa51412c6458adf8/users/fc5bf48faf4041f08f69dfce42e10a03/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:38.432589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.432990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.433266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.463710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] MFA Rules not processed for user `fc5bf48faf4041f08f69dfce42e10a03`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:38.465007 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:38.533873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1329/2642] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:38.538441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.612298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2ad9-1c30-4c3c-8533-a71e3debb420 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.617415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.618029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.618306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.618578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.619207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.621136 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.651845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1314/2643] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:38 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:38.653163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.664570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f3e33-70d4-4bb8-a6ef-2bef07a33a9c None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.710692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:38.737315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.737915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.738190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.738456 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.739073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.740985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.764763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1330/2644] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:38 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:38.766281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.776608 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655703a-5f3a-4594-8178-f46407bb29df admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.781889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.782489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.782768 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.783041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.783702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.785350 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.802214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1315/2645] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:38.806758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.818947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1e42-b972-45db-8eb8-d4ec81b94ec9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.823964 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.824619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.824926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.825225 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] PATH_INFO: `/v3/projects/60f4f82e8594460a82458887094cee14/users/a090c1708b174c4ca7dd3a6c1bec024f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.841914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f4f82e8594460a82458887094cee14, user_id=a090c1708b174c4ca7dd3a6c1bec024f, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.844907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.861977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1331/2646] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:38 2022] PUT /identity/v3/projects/60f4f82e8594460a82458887094cee14/users/a090c1708b174c4ca7dd3a6c1bec024f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:38.865991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.878507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315e5b4-71a9-4ebb-86d3-48d35309a874 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.941857 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2cb1a-cf80-4895-b5b3-9e82bf482d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.942478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2cb1a-cf80-4895-b5b3-9e82bf482d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.942811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2cb1a-cf80-4895-b5b3-9e82bf482d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.943030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2cb1a-cf80-4895-b5b3-9e82bf482d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.943710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2cb1a-cf80-4895-b5b3-9e82bf482d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.945322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2cb1a-cf80-4895-b5b3-9e82bf482d64 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.959143 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1316/2647] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:38.960326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:38.971491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea349e-8107-4d71-8224-2dbd62a3fee1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:38.976020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:38.976693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:38.976986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:38.977257 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] PATH_INFO: `/v3/projects/60f4f82e8594460a82458887094cee14/users/a090c1708b174c4ca7dd3a6c1bec024f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:38.979295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f4f82e8594460a82458887094cee14, user_id=a090c1708b174c4ca7dd3a6c1bec024f, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:38.982747 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:38.994372 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1332/2648] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:38 2022] PUT /identity/v3/projects/60f4f82e8594460a82458887094cee14/users/a090c1708b174c4ca7dd3a6c1bec024f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:39.004705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:39.005285 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:39.005700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:39.037998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] MFA Rules not processed for user `a090c1708b174c4ca7dd3a6c1bec024f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:39.039215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:39.048852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:39.113426 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1317/2649] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:39.125056 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:39.127018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:39.188883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61653085-9ef8-43cb-a2ad-2a11685e1649 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:39.192552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:39.193191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:39.193463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:39.193737 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:39.204319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:39.205779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:39.215173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1333/2650] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:39.298824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:39.309424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a144c-5c03-4efc-986b-5898139b7669 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:39.313865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:39.314471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:39.314746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:39.315015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:39.383500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:39.385145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:39.399392 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1318/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:41.936765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:41.938206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:42.002416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66817-1f44-44a2-806d-76539504c6cb service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:42.006037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:42.006626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:42.006899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:42.007164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:42.008902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:42.055906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:42.077061 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:42.078486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:42.088624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1334/2652] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:43.092166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:43.093543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:43.110680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0c91f-a8e4-4e9a-9a39-13c9ee9d0673 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:43.115160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:43.116100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:43.116534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:43.117108 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:43.119131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:43.211804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:43.213520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b22619-8031-4d54-b898-86035d9982bf service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:43.228599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1319/2653] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:45.659299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:45.669969 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb764-fb68-4cd7-bff4-3a4864268cc0 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:45.674462 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:45.675086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:45.675705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:45.675981 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] PATH_INFO: `/v3/users/fc5bf48faf4041f08f69dfce42e10a03` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:45.677148 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5bf48faf4041f08f69dfce42e10a03)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:45.679058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:45.738779 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5bf48faf4041f08f69dfce42e10a03'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:45.739332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5bf48faf4041f08f69dfce42e10a03'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:45.739914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5bf48faf4041f08f69dfce42e10a03'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:45.747774 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5bf48faf4041f08f69dfce42e10a03'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:45.755254 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5bf48faf4041f08f69dfce42e10a03'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:45.773657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1335/2654] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:45 2022] DELETE /identity/v3/users/fc5bf48faf4041f08f69dfce42e10a03 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:45.779024 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:45.779516 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:45.779698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:45.812980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:45.814332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:45.853684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:45.880155 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1320/2655] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:45.890637 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:45.892213 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:45.963019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d92b3-646c-41c1-bf14-482ab7465d0b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:45.968234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:45.968879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:45.969153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:45.969566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:45.980748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:45.982422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:45.992186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1336/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:46.279492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:46.281708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:46.294805 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78f7ba-ccd1-44fc-b1a2-563fa0c03aaa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:46.306288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:46.307189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:46.307685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:46.308151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] PATH_INFO: `/v3/projects/5ed9f3d236f84041aa51412c6458adf8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:46.311177 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed9f3d236f84041aa51412c6458adf8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:46.315972 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:46.368766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed9f3d236f84041aa51412c6458adf8', 'request_id': 'req-84870f83-6937-4ce2-af6b-886d699392dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.377120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed9f3d236f84041aa51412c6458adf8', 'request_id': 'req-84870f83-6937-4ce2-af6b-886d699392dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.383916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed9f3d236f84041aa51412c6458adf8', 'request_id': 'req-84870f83-6937-4ce2-af6b-886d699392dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.396889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] The token cache is being invalidate because project 5ed9f3d236f84041aa51412c6458adf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:46.397320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.398049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.402553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1321/2657] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:46 2022] DELETE /identity/v3/projects/5ed9f3d236f84041aa51412c6458adf8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:46.404885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:46.417207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301406b-5ca1-4686-b753-3b3bea714250 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:46.479362 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:46.489660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:46.490454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:46.490923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:46.491330 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] PATH_INFO: `/v3/users/a090c1708b174c4ca7dd3a6c1bec024f` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:46.493142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a090c1708b174c4ca7dd3a6c1bec024f)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:46.495332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:46.547972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a090c1708b174c4ca7dd3a6c1bec024f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.548623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a090c1708b174c4ca7dd3a6c1bec024f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.549415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a090c1708b174c4ca7dd3a6c1bec024f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.558034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a090c1708b174c4ca7dd3a6c1bec024f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.566567 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-2ee59e32-acda-42d9-a43c-933819efbd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a090c1708b174c4ca7dd3a6c1bec024f'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:46.587417 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1337/2658] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:46 2022] DELETE /identity/v3/users/a090c1708b174c4ca7dd3a6c1bec024f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:46.870532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:46.872620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:46.892347 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f83-6937-4ce2-af6b-886d699392dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:46.991090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:46.992368 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:46.992817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:46.993098 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] PATH_INFO: `/v3/projects/60f4f82e8594460a82458887094cee14` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:46.995145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f4f82e8594460a82458887094cee14)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:46.999486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.083532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f4f82e8594460a82458887094cee14', 'request_id': 'req-8c10c265-d33d-461d-876b-28e9607db0a4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:47.093824 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f4f82e8594460a82458887094cee14', 'request_id': 'req-8c10c265-d33d-461d-876b-28e9607db0a4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:47.100951 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f4f82e8594460a82458887094cee14', 'request_id': 'req-8c10c265-d33d-461d-876b-28e9607db0a4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:47.105450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:47.119761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] The token cache is being invalidate because project 60f4f82e8594460a82458887094cee14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:47.120056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:47.120738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c10c265-d33d-461d-876b-28e9607db0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:47.123723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1322/2659] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:46 2022] DELETE /identity/v3/projects/60f4f82e8594460a82458887094cee14 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:47.128524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.129069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.129069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.157205 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:47.158357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:47.233479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1338/2660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:47.241751 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867feda5-c854-4129-8134-1026356f877d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.242105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867feda5-c854-4129-8134-1026356f877d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.242478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867feda5-c854-4129-8134-1026356f877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.264113 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-867feda5-c854-4129-8134-1026356f877d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:47.265373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-867feda5-c854-4129-8134-1026356f877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:47.273273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1323/2661] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:47.277481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.288139 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0113e5-5b86-42c9-8c70-9a0dd5b3cefe None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.292886 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.293527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.293800 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.294070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.294714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:47.295123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.296717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.312046 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1339/2662] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:47.313464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867feda5-c854-4129-8134-1026356f877d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.323711 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867feda5-c854-4129-8134-1026356f877d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.328988 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.329583 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.329866 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.330128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.330763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.332639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.364542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1324/2663] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:47.366355 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.377427 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582600a4-d4a8-4777-9b22-2b39e05f920b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.437890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.438573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.438842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.439113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.439739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.441687 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.452717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:47.467788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1340/2664] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:47.471739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.482761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a91a3-2732-4e8c-980c-c245b8951ba3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.487212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.487806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.488080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.488343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.489006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.490574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.504529 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1325/2665] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:47.505802 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.520764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753fe6-703c-407f-9169-3f8ad62b55a9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.527438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6acd0-e233-4f80-b8c1-12e6ad68d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.529200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6acd0-e233-4f80-b8c1-12e6ad68d2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.529200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6acd0-e233-4f80-b8c1-12e6ad68d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.529469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6acd0-e233-4f80-b8c1-12e6ad68d2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.530126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6acd0-e233-4f80-b8c1-12e6ad68d2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.531745 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6acd0-e233-4f80-b8c1-12e6ad68d2c1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.543072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1341/2666] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:47.548122 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.559400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294bab6-edd0-467b-a4cf-6e04be23a973 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.564436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.565126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.565794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.565794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] PATH_INFO: `/v3/projects/1c7e667584da4aec9ac26041cdb80a2d/users/82608e15665447c294caf26573ccc315/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.581985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7e667584da4aec9ac26041cdb80a2d, user_id=82608e15665447c294caf26573ccc315, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.584664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.600546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1326/2667] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:47 2022] PUT /identity/v3/projects/1c7e667584da4aec9ac26041cdb80a2d/users/82608e15665447c294caf26573ccc315/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:47.612669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.613712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.614333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.653857 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] MFA Rules not processed for user `82608e15665447c294caf26573ccc315`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:47.655159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:47.725755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1342/2668] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:47.730082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.804878 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf708-d063-4c56-a7c6-87d6046d7a24 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.812196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.812960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.813384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.813821 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.814719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.818838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.854301 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1327/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:47.855482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.867022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73dca3-796a-438a-ac61-db65a95cdb61 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.928879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.929347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.929711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.930074 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.930808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.932813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:47.963272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1343/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:47 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:29:47.964746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:47.975789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba5ec-9d48-4952-9a91-c5f22ce1354f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:47.981685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:47.982755 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:47.983237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:47.983707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:47.984657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:47.986482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:48.127411 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1328/2671] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:48.128716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:48.139611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4708322-503b-45dd-b68b-2aeb91555733 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:48.144316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:48.145006 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.145279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.145547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] PATH_INFO: `/v3/projects/030b4eba9eb147e185fb2eb52fc65354/users/20a0afdc1a354d1b93bac578ab7de470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.162288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030b4eba9eb147e185fb2eb52fc65354, user_id=20a0afdc1a354d1b93bac578ab7de470, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:48.165140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:48.180835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1344/2672] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:48 2022] PUT /identity/v3/projects/030b4eba9eb147e185fb2eb52fc65354/users/20a0afdc1a354d1b93bac578ab7de470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:48.185481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:48.205166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ce3b-f048-4be9-8e0b-74a67c60f43d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:48.265064 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27c1c4-ef71-458c-bc61-03747429f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:48.265675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27c1c4-ef71-458c-bc61-03747429f0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.265960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27c1c4-ef71-458c-bc61-03747429f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.266225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27c1c4-ef71-458c-bc61-03747429f0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.266864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27c1c4-ef71-458c-bc61-03747429f0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:48.268444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27c1c4-ef71-458c-bc61-03747429f0ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:48.275639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:48.282509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1329/2673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:48.284242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:48.301911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fdaf8-fe64-4214-ba95-e00e20c6f047 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:48.307411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:48.307666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.308002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.308453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] PATH_INFO: `/v3/projects/030b4eba9eb147e185fb2eb52fc65354/users/20a0afdc1a354d1b93bac578ab7de470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.311555 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] RBAC: Authorizing `identity:create_grant(project_id=030b4eba9eb147e185fb2eb52fc65354, user_id=20a0afdc1a354d1b93bac578ab7de470, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:48.314480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:48.330412 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1345/2674] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:48 2022] PUT /identity/v3/projects/030b4eba9eb147e185fb2eb52fc65354/users/20a0afdc1a354d1b93bac578ab7de470/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:48.343112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.343393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.343662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.382186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] MFA Rules not processed for user `20a0afdc1a354d1b93bac578ab7de470`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:48.383603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:48.492206 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1330/2675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:48.510391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:48.512901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:48.563562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:48.610155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d228f-62dc-4f8a-a53d-77cc3c26724d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:48.614727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdb935-ced5-423d-b214-ab1935a54065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:48.615368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb935-ced5-423d-b214-ab1935a54065 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.615844 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb935-ced5-423d-b214-ab1935a54065 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.615986 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb935-ced5-423d-b214-ab1935a54065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.627783 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb935-ced5-423d-b214-ab1935a54065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:48.629391 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdb935-ced5-423d-b214-ab1935a54065 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:48.645314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1346/2676] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:48.679852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:48.754017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558039d-887b-4df3-8f20-2ba1e8194b3b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:48.759444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:48.760137 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.760467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.761173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] PATH_INFO: `/v3/users/82608e15665447c294caf26573ccc315` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.762416 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82608e15665447c294caf26573ccc315)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:48.765028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:48.829279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82608e15665447c294caf26573ccc315'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:48.839336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82608e15665447c294caf26573ccc315'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:48.840063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82608e15665447c294caf26573ccc315'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:48.840877 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82608e15665447c294caf26573ccc315'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:48.853324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82608e15665447c294caf26573ccc315'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:48.885996 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1331/2677] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:48 2022] DELETE /identity/v3/users/82608e15665447c294caf26573ccc315 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:48.891475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:48.892042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:48.892464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:48.915294 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:48.916659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.007710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1347/2678] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:49.019399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:49.020895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.030806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:49.111361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc2e2a-4de1-491f-a569-ec83fe737357 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:49.115846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:49.117366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:49.118306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:49.118591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:49.130691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:49.132612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:49.156858 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1332/2679] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:49.349847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:49.351327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.372471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64a7f-4c6b-4213-94db-8271cd322973 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:49.378777 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:49.379741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:49.380176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:49.380599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] PATH_INFO: `/v3/users/f0aee792cde84d38bc58c43309271766` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:49.381994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0aee792cde84d38bc58c43309271766)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:49.384167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:49.445778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0aee792cde84d38bc58c43309271766'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.446459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0aee792cde84d38bc58c43309271766'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.447327 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0aee792cde84d38bc58c43309271766'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.455576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0aee792cde84d38bc58c43309271766'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.463399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0aee792cde84d38bc58c43309271766'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.485400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1348/2680] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:49 2022] DELETE /identity/v3/users/f0aee792cde84d38bc58c43309271766 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:49.582953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:49.584400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.599530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d2b1-6eb0-4d69-b29d-be4470954eb0 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:49.679256 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:49.679894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:49.680173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:49.680439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] PATH_INFO: `/v3/projects/1c7e667584da4aec9ac26041cdb80a2d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:49.681625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7e667584da4aec9ac26041cdb80a2d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:49.683508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:49.721668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:49.723221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.740316 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4b76-7332-4a81-93a0-a2b0d9074c77 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:49.752336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7e667584da4aec9ac26041cdb80a2d', 'request_id': 'req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.762709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7e667584da4aec9ac26041cdb80a2d', 'request_id': 'req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.771303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7e667584da4aec9ac26041cdb80a2d', 'request_id': 'req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.784970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] The token cache is being invalidate because project 1c7e667584da4aec9ac26041cdb80a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:49.785674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.789012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.789012 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1333/2681] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:49 2022] DELETE /identity/v3/projects/1c7e667584da4aec9ac26041cdb80a2d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:49.802086 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:49.804265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:49.805321 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.833494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:49.834264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:49.834522 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:49.834794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] PATH_INFO: `/v3/projects/4f6a283abe66448fa777446a340cdd24` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:49.835926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6a283abe66448fa777446a340cdd24)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:49.838068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:49.860039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:49.896469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9167f-2f5b-4e8e-9c9a-8cebb7f9b102 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:49.901484 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6a283abe66448fa777446a340cdd24', 'request_id': 'req-56194574-9e10-45f3-b383-b6819751abf0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.909032 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6a283abe66448fa777446a340cdd24', 'request_id': 'req-56194574-9e10-45f3-b383-b6819751abf0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.916186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6a283abe66448fa777446a340cdd24', 'request_id': 'req-56194574-9e10-45f3-b383-b6819751abf0'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.930833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] The token cache is being invalidate because project 4f6a283abe66448fa777446a340cdd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:49.931124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.931918 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:49.933452 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1349/2682] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:49 2022] DELETE /identity/v3/projects/4f6a283abe66448fa777446a340cdd24 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:49.937830 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:49.940216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:49.973316 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:49.974489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:49.975166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:49.975543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] PATH_INFO: `/v3/users/20a0afdc1a354d1b93bac578ab7de470` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:49.977055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a0afdc1a354d1b93bac578ab7de470)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:49.979066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.022889 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194574-9e10-45f3-b383-b6819751abf0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.027776 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a0afdc1a354d1b93bac578ab7de470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.029299 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.030426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.030712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.030982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] PATH_INFO: `/v3/users/0cc25713e47c435abd2ef0ac7575d975` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.032232 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc25713e47c435abd2ef0ac7575d975)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.034350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.035604 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a0afdc1a354d1b93bac578ab7de470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.036298 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a0afdc1a354d1b93bac578ab7de470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.036954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a0afdc1a354d1b93bac578ab7de470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.044964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a0afdc1a354d1b93bac578ab7de470'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.066666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1334/2683] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:49 2022] DELETE /identity/v3/users/20a0afdc1a354d1b93bac578ab7de470 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:50.092039 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc25713e47c435abd2ef0ac7575d975'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.092698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc25713e47c435abd2ef0ac7575d975'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.093351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc25713e47c435abd2ef0ac7575d975'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.102153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc25713e47c435abd2ef0ac7575d975'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.109936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc25713e47c435abd2ef0ac7575d975'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.115871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:50.141388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1350/2684] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:49 2022] DELETE /identity/v3/users/0cc25713e47c435abd2ef0ac7575d975 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:50.326104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.327734 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:50.368650 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.371493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:50.407381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ebb0-c871-48b5-95ff-9875bc0c25fb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.415422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:50.447523 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06c87-0462-4510-b85a-e62b0af81d05 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.452192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.452848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.453129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.453401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] PATH_INFO: `/v3/projects/030b4eba9eb147e185fb2eb52fc65354` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.454514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=030b4eba9eb147e185fb2eb52fc65354)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.456428 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.472327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.472980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.473261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.473527 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] PATH_INFO: `/v3/projects/a46512ebdcfb452399eff7978c1d9fcc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.474626 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46512ebdcfb452399eff7978c1d9fcc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.476543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.505627 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030b4eba9eb147e185fb2eb52fc65354', 'request_id': 'req-3444c831-15dc-43a4-99f4-5fc8726f19f7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.513481 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030b4eba9eb147e185fb2eb52fc65354', 'request_id': 'req-3444c831-15dc-43a4-99f4-5fc8726f19f7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.519326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030b4eba9eb147e185fb2eb52fc65354', 'request_id': 'req-3444c831-15dc-43a4-99f4-5fc8726f19f7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.525520 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46512ebdcfb452399eff7978c1d9fcc', 'request_id': 'req-2ac4c030-c3b8-4930-b222-6963010b6600'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.532754 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] The token cache is being invalidate because project 030b4eba9eb147e185fb2eb52fc65354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:50.533303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.533562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46512ebdcfb452399eff7978c1d9fcc', 'request_id': 'req-2ac4c030-c3b8-4930-b222-6963010b6600'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.533955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-3444c831-15dc-43a4-99f4-5fc8726f19f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.535576 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1351/2685] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:50 2022] DELETE /identity/v3/projects/030b4eba9eb147e185fb2eb52fc65354 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:50.540190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.540354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46512ebdcfb452399eff7978c1d9fcc', 'request_id': 'req-2ac4c030-c3b8-4930-b222-6963010b6600'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.540535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.540815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.551221 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] The token cache is being invalidate because project a46512ebdcfb452399eff7978c1d9fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:50.551500 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.552128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ac4c030-c3b8-4930-b222-6963010b6600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:50.553633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1335/2686] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:50 2022] DELETE /identity/v3/projects/a46512ebdcfb452399eff7978c1d9fcc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:50.564404 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:50.565674 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:50.635470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1352/2687] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:50.644178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.644566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.645057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.666511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:50.667839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:50.676464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1336/2688] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:50.680603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.691808 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd591c-c385-4c45-a054-38e18911a95f None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.696492 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.697467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.697750 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.698020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.698683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:50.698983 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.701475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.715280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1353/2689] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:50.719831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.729588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4026a2-f72e-4479-b653-9084748ec8b4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.734486 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.735163 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.735448 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.735744 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.736417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.738386 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.772361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1337/2690] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:50 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:50.773578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.780669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:50.785164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9b100-1217-4d19-af72-cde9649ae07c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.850322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.850911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.851180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.851449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.852052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.853975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.875397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1354/2691] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:50 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:50.879541 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.890406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245526d4-a1ff-4d53-b72b-5420e8667d0c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.895107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.895700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.895977 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.896245 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.896949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.898596 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.908895 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1338/2692] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:50.912948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.923356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ba3e5-b617-4566-bbee-628ad2ab231c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.927927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f0e5-5768-4bd1-958c-bb8e550d633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.928512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f0e5-5768-4bd1-958c-bb8e550d633b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.928814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f0e5-5768-4bd1-958c-bb8e550d633b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.929080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f0e5-5768-4bd1-958c-bb8e550d633b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.929712 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f0e5-5768-4bd1-958c-bb8e550d633b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.931326 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f0e5-5768-4bd1-958c-bb8e550d633b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.942756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1355/2693] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:50.947166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:50.958603 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54328cbb-617f-4e7e-8d93-e09769b6b734 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:50.963391 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:50.964060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:50.964320 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:50.964588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] PATH_INFO: `/v3/projects/17328e7a67ba4ac0a4576672bcd18de2/users/d114864c9d4d4ecbbf64f5d4d6a8f33e/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:50.979975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=17328e7a67ba4ac0a4576672bcd18de2, user_id=d114864c9d4d4ecbbf64f5d4d6a8f33e, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:50.983188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:50.995948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1339/2694] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:50 2022] PUT /identity/v3/projects/17328e7a67ba4ac0a4576672bcd18de2/users/d114864c9d4d4ecbbf64f5d4d6a8f33e/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:51.006180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.006463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.006738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.035502 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] MFA Rules not processed for user `d114864c9d4d4ecbbf64f5d4d6a8f33e`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:51.036705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:51.103694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1356/2695] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:29:51.108383 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.152340 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:51.176930 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264430-3311-492a-9523-3ed51ac4d4df admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.189605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.189605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.189605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.189605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.189970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.189970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.220017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1340/2696] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:51 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:51.221172 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.234979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff851b0c-f600-445f-88ba-924549cb49a7 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.300599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.301308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.301653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.301926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.302547 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.304438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.325943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1357/2697] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:51 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:51.330030 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.340713 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda827-a0f2-4e1c-b841-6faa44e18d11 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.345540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.346215 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.346491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.346757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.347418 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.349026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.359789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1341/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:51.363806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.368873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:51.375935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89500937-9714-4c08-844e-8cdca428ac66 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.381070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.382015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.382288 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.382571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] PATH_INFO: `/v3/projects/910a1ec38984480b88f56f615538ff41/users/4d28eb52cbe34ba8ac299c127084404d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.398933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910a1ec38984480b88f56f615538ff41, user_id=4d28eb52cbe34ba8ac299c127084404d, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.401570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.414169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1358/2699] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:51 2022] PUT /identity/v3/projects/910a1ec38984480b88f56f615538ff41/users/4d28eb52cbe34ba8ac299c127084404d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:51.418057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.428591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9814c82-353c-4867-804c-2f1dc96f1098 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.487381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc146d12-d984-4b93-bd02-ad42e343479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.487981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146d12-d984-4b93-bd02-ad42e343479c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.488255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146d12-d984-4b93-bd02-ad42e343479c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.488522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc146d12-d984-4b93-bd02-ad42e343479c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.489184 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146d12-d984-4b93-bd02-ad42e343479c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.490781 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc146d12-d984-4b93-bd02-ad42e343479c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.501015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1342/2700] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:51.505244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.516060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bb6f6-2b76-481c-a8ed-3343f020a848 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.520610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.521361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.521900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.522424 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] PATH_INFO: `/v3/projects/910a1ec38984480b88f56f615538ff41/users/4d28eb52cbe34ba8ac299c127084404d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.524716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=910a1ec38984480b88f56f615538ff41, user_id=4d28eb52cbe34ba8ac299c127084404d, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.527347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.537744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1359/2701] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:51 2022] PUT /identity/v3/projects/910a1ec38984480b88f56f615538ff41/users/4d28eb52cbe34ba8ac299c127084404d/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:51.548799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.549129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.549402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.578563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] MFA Rules not processed for user `4d28eb52cbe34ba8ac299c127084404d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:51.579754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:51.647495 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1343/2702] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:51.659268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.661029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:51.718909 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80767-393b-46b4-9327-bca171b71ded admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.722592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.723183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.723455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.723720 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.733325 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.734736 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.743929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1360/2703] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:51.847809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:51.858575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c62a-3e66-4fe2-a14a-a1a506e7c162 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:51.862191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63636fe-f94a-40ae-a721-6fa8468faac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:51.862787 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63636fe-f94a-40ae-a721-6fa8468faac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:51.863060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63636fe-f94a-40ae-a721-6fa8468faac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:51.863323 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63636fe-f94a-40ae-a721-6fa8468faac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:51.893013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:51.920447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63636fe-f94a-40ae-a721-6fa8468faac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:51.921906 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63636fe-f94a-40ae-a721-6fa8468faac4 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:51.930513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1344/2704] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:54.514935 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:54.576281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d331-d0f0-4f0b-88c9-d5d9965b838c service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:54.580764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:54.581405 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:54.581678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:54.581942 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] PATH_INFO: `/v3/users/d114864c9d4d4ecbbf64f5d4d6a8f33e` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:54.583040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d114864c9d4d4ecbbf64f5d4d6a8f33e)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:54.584975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:54.631321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd114864c9d4d4ecbbf64f5d4d6a8f33e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:54.631954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd114864c9d4d4ecbbf64f5d4d6a8f33e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:54.632540 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd114864c9d4d4ecbbf64f5d4d6a8f33e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:54.640400 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd114864c9d4d4ecbbf64f5d4d6a8f33e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:54.647249 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd114864c9d4d4ecbbf64f5d4d6a8f33e'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:54.652251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:54.665912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1361/2705] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:54 2022] DELETE /identity/v3/users/d114864c9d4d4ecbbf64f5d4d6a8f33e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:54.670558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:54.671017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:54.671134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:54.689970 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:54.691084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:54.749518 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1345/2706] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:54.759156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:54.760548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:54.818429 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4f33-902b-4d31-b6aa-c324afd240dc admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:54.822284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:54.822870 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:54.823141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:54.823403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:54.832728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:54.834168 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:54.844016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1362/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:55.398891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:55.400311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:55.418188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89f162-db49-4fb6-9463-7ddedbadbfa2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:55.423480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:55.423681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:55.424001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:55.424279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] PATH_INFO: `/v3/projects/17328e7a67ba4ac0a4576672bcd18de2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:55.425431 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17328e7a67ba4ac0a4576672bcd18de2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:55.428037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:55.478444 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17328e7a67ba4ac0a4576672bcd18de2', 'request_id': 'req-510d5193-f424-4feb-9fb2-11a1b30a4b71'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.486198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17328e7a67ba4ac0a4576672bcd18de2', 'request_id': 'req-510d5193-f424-4feb-9fb2-11a1b30a4b71'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.492479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17328e7a67ba4ac0a4576672bcd18de2', 'request_id': 'req-510d5193-f424-4feb-9fb2-11a1b30a4b71'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.503373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] The token cache is being invalidate because project 17328e7a67ba4ac0a4576672bcd18de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:55.503657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.504272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.505763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1346/2708] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:55 2022] DELETE /identity/v3/projects/17328e7a67ba4ac0a4576672bcd18de2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:55.509756 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:55.519804 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021feb00-58a8-47fd-8a17-58fea2a9b9c8 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:55.576397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:55.577042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:55.577317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:55.577583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] PATH_INFO: `/v3/users/4d28eb52cbe34ba8ac299c127084404d` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:55.578681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d28eb52cbe34ba8ac299c127084404d)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:55.580588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:55.626755 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d28eb52cbe34ba8ac299c127084404d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.627397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d28eb52cbe34ba8ac299c127084404d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.628117 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d28eb52cbe34ba8ac299c127084404d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.635220 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d28eb52cbe34ba8ac299c127084404d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.642455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d1c10d5e-7c76-4722-b9f9-2e11621afb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d28eb52cbe34ba8ac299c127084404d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:55.659620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1363/2709] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:29:55 2022] DELETE /identity/v3/users/4d28eb52cbe34ba8ac299c127084404d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:55.948720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:55.950549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:55.971852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d5193-f424-4feb-9fb2-11a1b30a4b71 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.022479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:56.031960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.032563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.033276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.033726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] PATH_INFO: `/v3/projects/910a1ec38984480b88f56f615538ff41` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.035017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910a1ec38984480b88f56f615538ff41)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.037016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.084380 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910a1ec38984480b88f56f615538ff41', 'request_id': 'req-bb7d682c-e733-45a6-8337-008a4f7f0fe0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:56.092929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910a1ec38984480b88f56f615538ff41', 'request_id': 'req-bb7d682c-e733-45a6-8337-008a4f7f0fe0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:56.099130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910a1ec38984480b88f56f615538ff41', 'request_id': 'req-bb7d682c-e733-45a6-8337-008a4f7f0fe0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:56.110813 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] The token cache is being invalidate because project 910a1ec38984480b88f56f615538ff41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:29:56.111099 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:56.111799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bb7d682c-e733-45a6-8337-008a4f7f0fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:29:56.113478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1347/2710] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:29:55 2022] DELETE /identity/v3/projects/910a1ec38984480b88f56f615538ff41 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:56.118877 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.119161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.119431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.141959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:56.143141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:56.147307 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:56.207103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1364/2711] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:56.214679 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.215283 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.215772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.236317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:56.237639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:56.248573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1348/2712] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:56.252487 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.262301 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693d2e8-268b-4c26-bec8-69cb4c19c240 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.266902 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.267493 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.267765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.268029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.268669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:29:56.269009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.270578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.282065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1365/2713] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:29:56.286526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.297358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc37c-5553-4745-90ec-ee55d2ecf157 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.302005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.302600 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.302876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.303147 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.303794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.305731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.333361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1349/2714] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:56.337351 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.347714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680d7f-963c-44c0-b7bc-227681aab9a6 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.410146 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.410863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.411346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.411719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.412468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.414572 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.444545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1366/2715] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:56.449807 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.460892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54437b7-2b5c-47a0-8db5-636259d3b52a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.469041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.469041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.469041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.469041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.469370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.469370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.481557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1350/2716] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:56.485127 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.497114 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862493f-fb62-4ecb-bdee-c13c274f954d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.502240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf65a08-86ec-4a7f-bef3-2f2bc508454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.503332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf65a08-86ec-4a7f-bef3-2f2bc508454f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.503713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf65a08-86ec-4a7f-bef3-2f2bc508454f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.504115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf65a08-86ec-4a7f-bef3-2f2bc508454f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.504906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf65a08-86ec-4a7f-bef3-2f2bc508454f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.507183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf65a08-86ec-4a7f-bef3-2f2bc508454f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.518531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1367/2717] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:56.522561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.534458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510ffe-31d4-4098-925b-5b3b16d74c6f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.540220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.541267 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.541672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.542001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] PATH_INFO: `/v3/projects/4016f7ce1a864d1e98037c9d3042b4a0/users/5177b1ec006e4278a3ddcd6ab1e78d23/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.557628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4016f7ce1a864d1e98037c9d3042b4a0, user_id=5177b1ec006e4278a3ddcd6ab1e78d23, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.561459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.575020 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1351/2718] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:56 2022] PUT /identity/v3/projects/4016f7ce1a864d1e98037c9d3042b4a0/users/5177b1ec006e4278a3ddcd6ab1e78d23/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:56.585514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.586011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.586130 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.616533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] MFA Rules not processed for user `5177b1ec006e4278a3ddcd6ab1e78d23`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:56.617778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:56.690440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1368/2719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:56.694880 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.766400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dff6e-ba47-41e9-a4e8-f7a3006ca085 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.771385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.772120 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.772459 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.774107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.774107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.775469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.812801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1352/2720] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:56.822280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.830115 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:56.836055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d3e5-8356-4325-8b79-3df20d19da96 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.899352 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.900036 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.900237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.900509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.901185 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.904473 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.930014 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1369/2721] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:56 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:56.934178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:56.956922 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd6fe-e7d7-4b71-a25c-da07c802fc61 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:56.963413 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:56.972455 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:56.973028 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:56.973436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:56.974710 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:56.976759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:56.978721 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:56.993370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1353/2722] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:56.994692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.005219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee8009-7373-4273-8d13-3f8e75c24d9c admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.009895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb485-5aa5-44b4-b3c3-e9657f238249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.010490 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb485-5aa5-44b4-b3c3-e9657f238249 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.010762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb485-5aa5-44b4-b3c3-e9657f238249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.011030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb485-5aa5-44b4-b3c3-e9657f238249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.012285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cb485-5aa5-44b4-b3c3-e9657f238249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.013953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cb485-5aa5-44b4-b3c3-e9657f238249 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.025568 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1370/2723] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:57.030733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.041225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec6662-5882-4d90-b47e-215d220d59c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.046195 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.046841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.047116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.047384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] PATH_INFO: `/v3/projects/e3c7dc242c114439aaab0b2f1aa18047/users/e4462d0836764290856f48e2a1e598ce/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.062872 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c7dc242c114439aaab0b2f1aa18047, user_id=e4462d0836764290856f48e2a1e598ce, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.065685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.079764 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1354/2724] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:57 2022] PUT /identity/v3/projects/e3c7dc242c114439aaab0b2f1aa18047/users/e4462d0836764290856f48e2a1e598ce/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:57.091497 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.091794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.092060 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.120023 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] MFA Rules not processed for user `e4462d0836764290856f48e2a1e598ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:57.121319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:57.187985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1371/2725] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:57.192514 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.253331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fe288-f20e-42d3-8fc8-e68e86c8058d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.257912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.258509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.258790 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.259058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.259708 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.262129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.288983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1355/2726] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:29:57 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:57.293539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.304068 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af38d-7d7e-4f7a-aead-b2da257e27ab None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.359577 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.360163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.360434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.360694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.361339 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.363217 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.384250 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1372/2727] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:29:57 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:29:57.388341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.398496 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc744-4f86-4f5f-8a8d-0fc109dbd7ca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.403643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.404230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.404508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.404803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.405437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.407008 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.417179 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1356/2728] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:29:57.422121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.427113 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:57.432975 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd51df6-5af4-41b1-a76b-0a8965f6fca2 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.438940 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.439631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.439994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.440125 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] PATH_INFO: `/v3/projects/4741ef18565843da98798a8f2d89229a/users/9c1c255d6d25411cb15101db98a351ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.455019 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4741ef18565843da98798a8f2d89229a, user_id=9c1c255d6d25411cb15101db98a351ab, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.457719 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.471345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1373/2729] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:57 2022] PUT /identity/v3/projects/4741ef18565843da98798a8f2d89229a/users/9c1c255d6d25411cb15101db98a351ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:29:57.475190 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.485616 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8158c-115d-4468-9c0d-c03f892cb18f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.540399 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c4df8-a3af-4159-9f09-cbb8db3f5485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.541036 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c4df8-a3af-4159-9f09-cbb8db3f5485 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.541381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c4df8-a3af-4159-9f09-cbb8db3f5485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.541720 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c4df8-a3af-4159-9f09-cbb8db3f5485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.542419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c4df8-a3af-4159-9f09-cbb8db3f5485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.544398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c4df8-a3af-4159-9f09-cbb8db3f5485 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.558133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1357/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:29:57.559459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.569919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1a5dc-f021-4994-b5c2-23839b83a0b9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.574979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.575628 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.575905 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.576173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] PATH_INFO: `/v3/projects/4741ef18565843da98798a8f2d89229a/users/9c1c255d6d25411cb15101db98a351ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.578367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4741ef18565843da98798a8f2d89229a, user_id=9c1c255d6d25411cb15101db98a351ab, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.581033 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.592267 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1374/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:29:57 2022] PUT /identity/v3/projects/4741ef18565843da98798a8f2d89229a/users/9c1c255d6d25411cb15101db98a351ab/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:29:57.602331 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.602697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.602898 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.633048 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] MFA Rules not processed for user `9c1c255d6d25411cb15101db98a351ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:29:57.634260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:57.669130 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:57.712907 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1358/2732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:29:57.725079 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:57.726925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:29:57.800932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f824d-6fee-45fb-9fdc-5f5c2914b374 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:57.809571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:57.810177 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:57.810464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:57.810825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:57.873397 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:57.874838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:57.884320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1375/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:29:59.529115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:29:59.541067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0729-0e50-40de-8ac8-7225f1b08667 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:29:59.548322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:29:59.549096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:29:59.549446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:29:59.550336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:29:59.612105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:29:59.613801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:29:59.623284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1359/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:29:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:00.278793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:00.280420 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:00.292906 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b595bb-aea2-4a3c-b698-a35db7ed2462 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:00.297371 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:00.298043 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:00.298381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:00.298716 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:00.308418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:00.310508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:00.328897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1376/2735] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:03.654114 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:03.656212 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:03.726975 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f49eb-9517-4e30-aba5-de20d45ed245 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:03.731058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:03.731659 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:03.731985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:03.732257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:03.734045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:03.802304 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:03.803892 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa458c7a-fe74-40eb-913a-9063f02ffb6c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:03.817178 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1360/2736] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:04.244020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:04.254936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff3f4-c004-496e-97c8-6f4028d7173b service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:04.260080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:04.260835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:04.261112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:04.261504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] PATH_INFO: `/v3/users/5177b1ec006e4278a3ddcd6ab1e78d23` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:04.263854 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5177b1ec006e4278a3ddcd6ab1e78d23)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:04.265851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:04.320454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5177b1ec006e4278a3ddcd6ab1e78d23'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.321186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5177b1ec006e4278a3ddcd6ab1e78d23'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.322222 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5177b1ec006e4278a3ddcd6ab1e78d23'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.330875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5177b1ec006e4278a3ddcd6ab1e78d23'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.338155 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:04.341240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5177b1ec006e4278a3ddcd6ab1e78d23'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.369042 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1377/2737] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:04 2022] DELETE /identity/v3/users/5177b1ec006e4278a3ddcd6ab1e78d23 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:04.373676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:04.374042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:04.374381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:04.380193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:04.394332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:04.395441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:04.395683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:04.410847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:04.478647 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a62299-c63e-4400-80f7-34891b63f266 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:04.479121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1361/2738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:04.487566 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:04.488230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:04.488512 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:04.488944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] PATH_INFO: `/v3/users/6661ed17eef94eaebd0761448a0758e4` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:04.489810 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:04.491188 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6661ed17eef94eaebd0761448a0758e4)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:04.491560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:04.493141 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:04.547548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6661ed17eef94eaebd0761448a0758e4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.548200 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6661ed17eef94eaebd0761448a0758e4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.548856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6661ed17eef94eaebd0761448a0758e4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.556727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6661ed17eef94eaebd0761448a0758e4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.565758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6661ed17eef94eaebd0761448a0758e4'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:04.579270 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167d302-8787-4ebc-8c5b-ff182c55c75b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:04.584606 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:04.585699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:04.585699 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:04.586032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:04.587592 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1378/2739] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:04 2022] DELETE /identity/v3/users/6661ed17eef94eaebd0761448a0758e4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:04.588145 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:04.601370 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:04.602938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:04.615737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1362/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:05.000538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:05.002259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:05.134005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:05.136154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:05.150751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:05.156218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31905d54-727a-45ff-9949-3c1f18a11faa admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:05.162393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:05.163850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:05.164285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:05.165230 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] PATH_INFO: `/v3/projects/67c13f4b01b6440d9d184346d11ec7ff` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:05.166794 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c13f4b01b6440d9d184346d11ec7ff)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:05.170454 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:05.172719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db36cbd-78ad-4607-b4e6-1423c4f62155 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:05.178477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:05.179772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:05.180172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:05.180682 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] PATH_INFO: `/v3/projects/4016f7ce1a864d1e98037c9d3042b4a0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:05.181999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4016f7ce1a864d1e98037c9d3042b4a0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:05.183987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:05.246327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4016f7ce1a864d1e98037c9d3042b4a0', 'request_id': 'req-d2963bb5-de08-48f0-b31f-668207b0b78d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.250106 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c13f4b01b6440d9d184346d11ec7ff', 'request_id': 'req-c73bb117-e537-4eae-83e4-97be61bcce80'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.256077 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4016f7ce1a864d1e98037c9d3042b4a0', 'request_id': 'req-d2963bb5-de08-48f0-b31f-668207b0b78d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.260614 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c13f4b01b6440d9d184346d11ec7ff', 'request_id': 'req-c73bb117-e537-4eae-83e4-97be61bcce80'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.267229 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4016f7ce1a864d1e98037c9d3042b4a0', 'request_id': 'req-d2963bb5-de08-48f0-b31f-668207b0b78d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.268605 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c13f4b01b6440d9d184346d11ec7ff', 'request_id': 'req-c73bb117-e537-4eae-83e4-97be61bcce80'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.280484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] The token cache is being invalidate because project 4016f7ce1a864d1e98037c9d3042b4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:05.280893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.281612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.286284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1363/2741] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:05 2022] DELETE /identity/v3/projects/4016f7ce1a864d1e98037c9d3042b4a0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:05.286430 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] The token cache is being invalidate because project 67c13f4b01b6440d9d184346d11ec7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:05.286695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.287297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:05.287421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.288725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:05.291724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1379/2742] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:04 2022] DELETE /identity/v3/projects/67c13f4b01b6440d9d184346d11ec7ff => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:05.292806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:05.294206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:05.337225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:05.360207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963bb5-de08-48f0-b31f-668207b0b78d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:05.364756 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:05.365408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:05.365683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:05.365947 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] PATH_INFO: `/v3/users/e4462d0836764290856f48e2a1e598ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:05.367083 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4462d0836764290856f48e2a1e598ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:05.368993 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:05.369262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb117-e537-4eae-83e4-97be61bcce80 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:05.374578 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:05.375195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:05.375465 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:05.375734 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] PATH_INFO: `/v3/users/0b2d27965fb14ec98d7397a90d123464` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:05.377112 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2d27965fb14ec98d7397a90d123464)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:05.379015 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:05.430028 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2d27965fb14ec98d7397a90d123464'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.430862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2d27965fb14ec98d7397a90d123464'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.431472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2d27965fb14ec98d7397a90d123464'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.431656 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4462d0836764290856f48e2a1e598ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.441598 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4462d0836764290856f48e2a1e598ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.442384 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4462d0836764290856f48e2a1e598ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.443078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4462d0836764290856f48e2a1e598ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.444457 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2d27965fb14ec98d7397a90d123464'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.453359 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-585da547-695e-4044-b2bb-4178b5b38877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2d27965fb14ec98d7397a90d123464'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.453560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4462d0836764290856f48e2a1e598ce'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:05.482258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1364/2743] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:05 2022] DELETE /identity/v3/users/e4462d0836764290856f48e2a1e598ce => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:05.488519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1380/2744] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:05 2022] DELETE /identity/v3/users/0b2d27965fb14ec98d7397a90d123464 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:05.828085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:05.830151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:05.906309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872634a4-5fcb-4f97-9ad5-c71032614570 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:05.983134 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:05.984026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:05.984446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:05.984728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] PATH_INFO: `/v3/projects/6cedf282b9874c958ecaa6aa8ecb1381` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:05.986199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cedf282b9874c958ecaa6aa8ecb1381)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:05.988018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:05.999543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:06.043148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cedf282b9874c958ecaa6aa8ecb1381', 'request_id': 'req-55f3a607-1df5-49df-9f63-d3f3afe86226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.052423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cedf282b9874c958ecaa6aa8ecb1381', 'request_id': 'req-55f3a607-1df5-49df-9f63-d3f3afe86226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.059798 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cedf282b9874c958ecaa6aa8ecb1381', 'request_id': 'req-55f3a607-1df5-49df-9f63-d3f3afe86226'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.072587 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] The token cache is being invalidate because project 6cedf282b9874c958ecaa6aa8ecb1381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:06.072911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.074186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.075983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1365/2745] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:05 2022] DELETE /identity/v3/projects/6cedf282b9874c958ecaa6aa8ecb1381 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:06.081001 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e6af2-2de0-424f-8dba-5061e0a9bd88 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.081293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e6af2-2de0-424f-8dba-5061e0a9bd88 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.081565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e6af2-2de0-424f-8dba-5061e0a9bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.096571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:06.109670 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-651e6af2-2de0-424f-8dba-5061e0a9bd88 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:06.113102 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-651e6af2-2de0-424f-8dba-5061e0a9bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.138185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.140498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.191373 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1381/2746] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:06.199903 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.200201 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.200606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.222536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:06.223770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.230454 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a607-1df5-49df-9f63-d3f3afe86226 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.235933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1382/2747] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:06.236991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.238019 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.239214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.239214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.239489 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] PATH_INFO: `/v3/projects/e3c7dc242c114439aaab0b2f1aa18047` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.240801 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c7dc242c114439aaab0b2f1aa18047)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.243509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.254086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52af68-79a0-4233-8722-cae103bd5c11 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.260696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.262008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.262396 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.262730 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.263573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:06.263961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.265653 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.280394 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1383/2748] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:06.285593 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.300111 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05937ac1-07f9-41d5-a8a3-4ce265df3eac admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.310745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c7dc242c114439aaab0b2f1aa18047', 'request_id': 'req-e1c21668-1144-4e0c-82cd-9772c8b96df0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.320439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c7dc242c114439aaab0b2f1aa18047', 'request_id': 'req-e1c21668-1144-4e0c-82cd-9772c8b96df0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.328244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c7dc242c114439aaab0b2f1aa18047', 'request_id': 'req-e1c21668-1144-4e0c-82cd-9772c8b96df0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.342354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] The token cache is being invalidate because project e3c7dc242c114439aaab0b2f1aa18047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:06.342794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.343551 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.345586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1366/2749] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:06 2022] DELETE /identity/v3/projects/e3c7dc242c114439aaab0b2f1aa18047 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:06.349523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.351678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.367480 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.368409 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.368681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.369329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.369971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.371897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.390624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:06.410773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1384/2750] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:06 2022] POST /identity/v3/projects => generated 361 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:06.413011 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.416274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.435371 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c21668-1144-4e0c-82cd-9772c8b96df0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.501029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4399-01f6-4e1e-a8a6-c1ac5fe92a5d admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.509283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.510873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.512748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.513449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.514008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.516434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.532402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.533191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.533619 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.533963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] PATH_INFO: `/v3/users/9c1c255d6d25411cb15101db98a351ab` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.535286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1c255d6d25411cb15101db98a351ab)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.537786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.546616 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1385/2751] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:06 2022] POST /identity/v3/users => generated 281 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:06.550403 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.559666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:06.565414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c45007-6ed5-40f8-976e-45963f3d55f8 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.571835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.572436 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.572966 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.573096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.573660 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.575926 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.588631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1386/2752] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:06.593136 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.603484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1c255d6d25411cb15101db98a351ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.603884 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a6ee-766d-4e42-8765-f9d32905d7fa admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.611393 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.611895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.612173 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.612943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.613120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.614706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.615186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1c255d6d25411cb15101db98a351ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.616105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1c255d6d25411cb15101db98a351ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.616843 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1c255d6d25411cb15101db98a351ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.625663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ee94481b-a366-4c33-ba15-b963c4d95479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1c255d6d25411cb15101db98a351ab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:06.626692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1387/2753] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:06.630678 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.633347 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.646458 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28914da3-3463-4d99-83b7-aa52702314b5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:06.647474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1367/2754] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:06 2022] DELETE /identity/v3/users/9c1c255d6d25411cb15101db98a351ab => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:06.711494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:06.712191 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.712637 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.712885 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] PATH_INFO: `/v3/projects/009cf64b99eb4a87abe2495b827a3ea5/users/617ee3ef84594293b14f468b01e91143/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.734103 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=009cf64b99eb4a87abe2495b827a3ea5, user_id=617ee3ef84594293b14f468b01e91143, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:06.737133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:06.760961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1388/2755] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:06 2022] PUT /identity/v3/projects/009cf64b99eb4a87abe2495b827a3ea5/users/617ee3ef84594293b14f468b01e91143/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:06.778192 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:06.778477 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:06.778899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:06.816084 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] MFA Rules not processed for user `617ee3ef84594293b14f468b01e91143`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:06.817522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:06.884701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:06.915265 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1368/2756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:06.955543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:06.957634 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.013601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.016123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.062921 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbade93-789f-4f54-b8f3-9636fe483b0e admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.067622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.068406 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.068799 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.069129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.086195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.087767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.100101 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1389/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:07.125280 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.166580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5f72-3e1f-4711-abe9-833e86355ddc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.175348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.176409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.176914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.177422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] PATH_INFO: `/v3/projects/4741ef18565843da98798a8f2d89229a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.178990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4741ef18565843da98798a8f2d89229a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.181832 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.207219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4c3d-7ddd-454e-8ec4-d62617ffa99e service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.221259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.221837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.222157 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.222365 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] PATH_INFO: `/v3/users/617ee3ef84594293b14f468b01e91143` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.224285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=617ee3ef84594293b14f468b01e91143)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.226303 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.238472 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:07.305327 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4741ef18565843da98798a8f2d89229a', 'request_id': 'req-eed0e93b-a791-4a12-a8d0-74c271c81633'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.318735 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4741ef18565843da98798a8f2d89229a', 'request_id': 'req-eed0e93b-a791-4a12-a8d0-74c271c81633'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.333564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4741ef18565843da98798a8f2d89229a', 'request_id': 'req-eed0e93b-a791-4a12-a8d0-74c271c81633'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.358809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] The token cache is being invalidate because project 4741ef18565843da98798a8f2d89229a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:07.359170 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.360002 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eed0e93b-a791-4a12-a8d0-74c271c81633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.366413 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617ee3ef84594293b14f468b01e91143'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.367460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617ee3ef84594293b14f468b01e91143'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.368660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1369/2758] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:07 2022] DELETE /identity/v3/projects/4741ef18565843da98798a8f2d89229a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:07.380045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f312-3875-4eba-bbde-99fc69f37dd6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.381034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f312-3875-4eba-bbde-99fc69f37dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.381326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f312-3875-4eba-bbde-99fc69f37dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.386728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617ee3ef84594293b14f468b01e91143'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.405849 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617ee3ef84594293b14f468b01e91143'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.423247 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-cacd82a0-c986-4aaa-bfd2-cc053176e76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617ee3ef84594293b14f468b01e91143'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:07.426792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e85f312-3875-4eba-bbde-99fc69f37dd6 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:07.430065 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e85f312-3875-4eba-bbde-99fc69f37dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.460874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1390/2759] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:07 2022] DELETE /identity/v3/users/617ee3ef84594293b14f468b01e91143 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:07.462922 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.463270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.463608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.500681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:07.502324 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.539643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1370/2760] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:07.615697 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.616322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.616322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.636815 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1391/2761] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:07.641355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:07.644254 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.650221 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.654565 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.663305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1371/2762] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:07.665107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.681672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afe33-0cf7-4276-97d7-8a4cd86393e8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.689601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.690218 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.690492 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.690759 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.692237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:07.693360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.695373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.711424 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:07.732622 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1372/2763] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:07.737074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.754976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d42c6-13f4-4bda-9895-d8dcd501b49f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.761246 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.762601 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.763055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.763491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.764349 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.765529 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a36e0-4511-422d-a2cb-206d034e7f78 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.768564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.771635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.772912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.773279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.773643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.786238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.787923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.817654 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1392/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:30:07.827961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1373/2765] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:07.835082 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.859180 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89d0c-0386-4295-923a-1873f8b76e38 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:07.895994 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:07.918194 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:07.925247 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:07.962636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:07.963588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:07.964096 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:07.964663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:07.965562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:07.967847 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:07.996669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1393/2766] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:07 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:08.000738 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.017657 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d684a5-370b-40a5-bf9a-49bbe6d876a1 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.023083 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.023696 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.023970 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.024236 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.025018 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.026826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.038162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1394/2767] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:08.042422 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.044731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3c34-f5dd-4328-9cb9-8897ce1b4757 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.050107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.050831 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.051112 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.051406 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] PATH_INFO: `/v3/users/0c34731e291046cbb634305a95ead7b6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.052655 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c34731e291046cbb634305a95ead7b6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.053952 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f03a-1d50-4ef3-825a-a300cdb28cba admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.054605 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.060757 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.062334 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.062731 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.063005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.063937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.065453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.084388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1395/2768] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:08.088151 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.098482 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c725-dd51-47d1-b5f0-7c606252ed78 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.103345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf7d4-b31e-4d26-b91e-a9090e99c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.104071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf7d4-b31e-4d26-b91e-a9090e99c05f admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.104425 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf7d4-b31e-4d26-b91e-a9090e99c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.104894 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf7d4-b31e-4d26-b91e-a9090e99c05f admin admin] PATH_INFO: `/v3/projects/39387b8edcee413fba152a99a068b06d/users/d74152b6468e41b4aed6148e18ac5af6/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.105458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c34731e291046cbb634305a95ead7b6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.113168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c34731e291046cbb634305a95ead7b6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.113914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c34731e291046cbb634305a95ead7b6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.114570 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c34731e291046cbb634305a95ead7b6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.124077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecf7d4-b31e-4d26-b91e-a9090e99c05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39387b8edcee413fba152a99a068b06d, user_id=d74152b6468e41b4aed6148e18ac5af6, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.124288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c34731e291046cbb634305a95ead7b6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.127925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecf7d4-b31e-4d26-b91e-a9090e99c05f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.145464 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1396/2769] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:08 2022] PUT /identity/v3/projects/39387b8edcee413fba152a99a068b06d/users/d74152b6468e41b4aed6148e18ac5af6/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:08.145987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1374/2770] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:07 2022] DELETE /identity/v3/users/0c34731e291046cbb634305a95ead7b6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:08.156105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.156415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.156695 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.164957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.166436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.212121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] MFA Rules not processed for user `d74152b6468e41b4aed6148e18ac5af6`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:08.213387 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.238929 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:08.254456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c2ca4-32e7-4d93-a72b-79897c810d84 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.260560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.261557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.262033 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.262390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] PATH_INFO: `/v3/projects/009cf64b99eb4a87abe2495b827a3ea5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.263549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009cf64b99eb4a87abe2495b827a3ea5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.265557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.291395 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1397/2771] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:08.303410 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.304957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.325574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009cf64b99eb4a87abe2495b827a3ea5', 'request_id': 'req-c5dfee10-97b3-44a4-91d7-d597ae3525b1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.340227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009cf64b99eb4a87abe2495b827a3ea5', 'request_id': 'req-c5dfee10-97b3-44a4-91d7-d597ae3525b1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.349056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009cf64b99eb4a87abe2495b827a3ea5', 'request_id': 'req-c5dfee10-97b3-44a4-91d7-d597ae3525b1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.362778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] The token cache is being invalidate because project 009cf64b99eb4a87abe2495b827a3ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:08.363146 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.364005 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.365978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1375/2772] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:08 2022] DELETE /identity/v3/projects/009cf64b99eb4a87abe2495b827a3ea5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:08.366648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.370039 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.376216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea95c3-dcff-4889-aadb-bb2f2293d12e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.390446 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:08.428108 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.428744 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.429041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.429309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.431086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.440358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfee10-97b3-44a4-91d7-d597ae3525b1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.445175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.445740 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.446016 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.446550 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] PATH_INFO: `/v3/projects/a12b079b874b4cf3b9a4f4b9202d880b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.447683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12b079b874b4cf3b9a4f4b9202d880b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.450421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.492955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.494401 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9afd0-9a7a-4742-8be2-03d0714d7d8e service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.501252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12b079b874b4cf3b9a4f4b9202d880b', 'request_id': 'req-12a561f1-6f96-4a07-89e0-e03434df63d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.503878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1398/2773] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:30:08.505333 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dddab5-8153-4175-8109-1aefe2c0684d None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.505617 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dddab5-8153-4175-8109-1aefe2c0684d None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.505880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dddab5-8153-4175-8109-1aefe2c0684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.512437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12b079b874b4cf3b9a4f4b9202d880b', 'request_id': 'req-12a561f1-6f96-4a07-89e0-e03434df63d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.520057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12b079b874b4cf3b9a4f4b9202d880b', 'request_id': 'req-12a561f1-6f96-4a07-89e0-e03434df63d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.533066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] The token cache is being invalidate because project a12b079b874b4cf3b9a4f4b9202d880b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:08.533379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.534054 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.535548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1376/2774] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:08 2022] DELETE /identity/v3/projects/a12b079b874b4cf3b9a4f4b9202d880b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:08.536292 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.537591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.539882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-43dddab5-8153-4175-8109-1aefe2c0684d None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:08.541126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-43dddab5-8153-4175-8109-1aefe2c0684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.551743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:08.602314 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1399/2775] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:08.603692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bb16-e3e7-49a6-a1c1-20694d4d5664 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.603979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bb16-e3e7-49a6-a1c1-20694d4d5664 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.604246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23bb16-e3e7-49a6-a1c1-20694d4d5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.606460 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a561f1-6f96-4a07-89e0-e03434df63d1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.611538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.612329 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.612613 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.612925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] PATH_INFO: `/v3/users/d74152b6468e41b4aed6148e18ac5af6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.614068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74152b6468e41b4aed6148e18ac5af6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.616035 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.626811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5a23bb16-e3e7-49a6-a1c1-20694d4d5664 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:08.628190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5a23bb16-e3e7-49a6-a1c1-20694d4d5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.635990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1400/2776] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:08.637463 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dc18f-8ded-4454-948e-e4dfde87fd4e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.637742 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dc18f-8ded-4454-948e-e4dfde87fd4e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.638013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dc18f-8ded-4454-948e-e4dfde87fd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.661553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-369dc18f-8ded-4454-948e-e4dfde87fd4e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:08.662740 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-369dc18f-8ded-4454-948e-e4dfde87fd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.664945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74152b6468e41b4aed6148e18ac5af6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.671278 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1401/2777] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:08.672462 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74152b6468e41b4aed6148e18ac5af6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.672586 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5d391-6e32-4fc8-a1a7-ddeb1667ac16 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.672904 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5d391-6e32-4fc8-a1a7-ddeb1667ac16 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.673084 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5d391-6e32-4fc8-a1a7-ddeb1667ac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.673244 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74152b6468e41b4aed6148e18ac5af6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.673850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74152b6468e41b4aed6148e18ac5af6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.681593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74152b6468e41b4aed6148e18ac5af6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:08.693881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-92e5d391-6e32-4fc8-a1a7-ddeb1667ac16 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:08.695389 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-92e5d391-6e32-4fc8-a1a7-ddeb1667ac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.700562 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1377/2778] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:08 2022] DELETE /identity/v3/users/d74152b6468e41b4aed6148e18ac5af6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:08.701360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.702672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.704841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1402/2779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:08.705996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.706269 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.706534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.725244 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:08.726411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.768986 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde04e-63a9-45df-bb0b-2c51601e7c97 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.774270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:08.775210 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.775792 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.776164 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.776356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.777865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:08.778097 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.779650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.788711 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1403/2780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:08.789615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.795258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1378/2781] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:08.797446 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.800017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523457f-31fe-4843-9b90-ce064b7ca791 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.804714 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.805343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.805615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.805881 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.806531 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:08.806823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.809354 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.810743 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dbaa7-9d97-42fc-b512-43e65fe0df2f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.815760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.816362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.816673 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.817157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.817789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.819692 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.823776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1404/2782] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:08.824715 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.826530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:08.849034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1379/2783] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:08.850346 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.856537 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:08.890573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180813-a605-4fb1-855c-be471c9c1a93 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.917044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faeee-365d-4b58-ad02-02ccf80ac926 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:08.922381 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.922979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.923261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.923528 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.924142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.926043 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.939092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:08.939698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:08.939974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:08.940251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:08.950093 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:08.951494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:08.954085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1380/2784] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:08.955009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.965215 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1405/2785] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:08.966027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:08.975724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50617-9a6c-4ff1-9f0f-9126898ad99e service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.022573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ad94-4981-4df4-a799-81a7949d744c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.029087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.029778 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.030070 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.030335 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.030994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.032933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.049546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.050161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.050735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.051013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.051683 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.053680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.059004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1381/2786] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:09.060202 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.074702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad43c1-f7e1-4354-b4b4-09fd5bc5efa0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.080440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1406/2787] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:08 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:09.080610 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.081257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.081540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.081818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.082457 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.084322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.084464 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.095086 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176695-ad87-4578-85af-18daf8252c98 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.101013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1382/2788] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:09.101179 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.101606 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.101723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.102041 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.102311 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.102709 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.104319 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.115066 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed85cd-6cbc-4980-a48f-1df3f06d7902 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.115943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1407/2789] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:09.119883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.120738 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.121571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.121889 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.122121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.122772 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.124362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.135323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145145-adfc-49a5-b60d-781e65b7d31a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.137231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1383/2790] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:09.140848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.144289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.145022 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.145369 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.145713 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.146434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.148097 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.151032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfd69f-f6be-4101-8b3f-804678b886e1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.158563 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7935-97d7-4bb6-ac0d-e0ce33e7e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.159260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7935-97d7-4bb6-ac0d-e0ce33e7e1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.159542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7935-97d7-4bb6-ac0d-e0ce33e7e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.159811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7935-97d7-4bb6-ac0d-e0ce33e7e1f6 admin admin] PATH_INFO: `/v3/projects/7cf4b1d8c05947e88e4bb888f876cd78/users/d650fb334ee64d43ad47eb421f399e14/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.160860 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1408/2791] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:09.165792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.177272 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d5467-990d-4de0-8612-5fc184bb89e0 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.177468 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7935-97d7-4bb6-ac0d-e0ce33e7e1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf4b1d8c05947e88e4bb888f876cd78, user_id=d650fb334ee64d43ad47eb421f399e14, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.180031 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7935-97d7-4bb6-ac0d-e0ce33e7e1f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.182192 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56cdd9-155d-470f-a31e-c0fa79cbaee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.182963 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cdd9-155d-470f-a31e-c0fa79cbaee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.183421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cdd9-155d-470f-a31e-c0fa79cbaee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.183803 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56cdd9-155d-470f-a31e-c0fa79cbaee9 admin admin] PATH_INFO: `/v3/projects/9b912f826cda4972a27c4d6318be047c/users/b8808cec13f74920b570fcb4ba4df940/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.186588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:09.197403 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1384/2792] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:09 2022] PUT /identity/v3/projects/7cf4b1d8c05947e88e4bb888f876cd78/users/d650fb334ee64d43ad47eb421f399e14/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:09.207090 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56cdd9-155d-470f-a31e-c0fa79cbaee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b912f826cda4972a27c4d6318be047c, user_id=b8808cec13f74920b570fcb4ba4df940, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.208342 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.209157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.209157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.212837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56cdd9-155d-470f-a31e-c0fa79cbaee9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.247198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1409/2793] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:09 2022] PUT /identity/v3/projects/9b912f826cda4972a27c4d6318be047c/users/b8808cec13f74920b570fcb4ba4df940/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:09.247437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] MFA Rules not processed for user `d650fb334ee64d43ad47eb421f399e14`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:09.247437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.249246 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0673-8877-466f-93af-0b0c2697967b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.249534 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0673-8877-466f-93af-0b0c2697967b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.250541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0673-8877-466f-93af-0b0c2697967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.281531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:09.300948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-341b0673-8877-466f-93af-0b0c2697967b None None] MFA Rules not processed for user `b8808cec13f74920b570fcb4ba4df940`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:09.302193 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-341b0673-8877-466f-93af-0b0c2697967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.341278 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1385/2794] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:09.342189 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.343709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.378726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1410/2795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:09.379573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0673-8877-466f-93af-0b0c2697967b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.383281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-341b0673-8877-466f-93af-0b0c2697967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.413150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802632a-f390-424a-8302-4310d6e0a3ad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.418006 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822f2a-978f-4907-8868-54096075108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.418705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822f2a-978f-4907-8868-54096075108b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.418984 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822f2a-978f-4907-8868-54096075108b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.419250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822f2a-978f-4907-8868-54096075108b admin admin] PATH_INFO: `/v3/projects/39387b8edcee413fba152a99a068b06d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.420357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822f2a-978f-4907-8868-54096075108b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39387b8edcee413fba152a99a068b06d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.422293 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822f2a-978f-4907-8868-54096075108b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.442535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0673-8877-466f-93af-0b0c2697967b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.446491 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.447091 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.447368 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.447638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.459896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.461262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.470287 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-37822f2a-978f-4907-8868-54096075108b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39387b8edcee413fba152a99a068b06d', 'request_id': 'req-37822f2a-978f-4907-8868-54096075108b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:09.470439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1411/2796] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:09.471183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.478999 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-37822f2a-978f-4907-8868-54096075108b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39387b8edcee413fba152a99a068b06d', 'request_id': 'req-37822f2a-978f-4907-8868-54096075108b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:09.483571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672ca3-d51e-4c7a-9fa8-3185e00b1484 service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.485959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-37822f2a-978f-4907-8868-54096075108b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39387b8edcee413fba152a99a068b06d', 'request_id': 'req-37822f2a-978f-4907-8868-54096075108b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:09.497498 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-37822f2a-978f-4907-8868-54096075108b admin admin] The token cache is being invalidate because project 39387b8edcee413fba152a99a068b06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:09.498090 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-37822f2a-978f-4907-8868-54096075108b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:09.498933 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-37822f2a-978f-4907-8868-54096075108b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:09.500584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1386/2797] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:09 2022] DELETE /identity/v3/projects/39387b8edcee413fba152a99a068b06d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:09.505433 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f66c-e80f-4527-aab2-9d91975ed7a7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.505888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f66c-e80f-4527-aab2-9d91975ed7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.506348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f66c-e80f-4527-aab2-9d91975ed7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.530174 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9b34f66c-e80f-4527-aab2-9d91975ed7a7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:09.531962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b34f66c-e80f-4527-aab2-9d91975ed7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.544717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.545514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.545706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.545930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.546550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.548426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.575658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:09.587551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1412/2798] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:09.588620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.589607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:09.590435 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.608838 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1387/2799] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:09.616453 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.616862 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.617410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.641916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:09.643376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:09.671519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38a635-9afa-465d-8769-bb3d55f6bc76 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.677063 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.677823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.678020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.678292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.678919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.680890 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.705658 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1413/2800] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:09.709411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.719881 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1388/2801] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:09.721508 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350d57-2f0f-45d5-a023-763c2dcd8547 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.724439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.726957 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.727554 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.727827 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.728121 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.728728 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.731908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.736689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5560d-97b1-4bed-8689-d5e2b9f7d42f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.741654 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.742467 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.742808 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.743115 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.743731 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:09.744219 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.746276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.747507 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1414/2802] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:09.753767 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.761536 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1389/2803] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:30:09.765749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.770451 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7cdcb-7b78-4a89-90cc-1bd483907bad admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.775893 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.777311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.777791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.778259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] PATH_INFO: `/v3/projects/8517d42fabf0495a9eb503cd72cec867/users/5fa97ca1759a4c83ab7e9c37c9cfbe79/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.778894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446bb09-51e4-4030-b3db-b5c34dc90ebd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.784255 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.784888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.785168 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.785439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.786362 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.788328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.797156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8517d42fabf0495a9eb503cd72cec867, user_id=5fa97ca1759a4c83ab7e9c37c9cfbe79, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.817122 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.831214 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1415/2804] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:09 2022] PUT /identity/v3/projects/8517d42fabf0495a9eb503cd72cec867/users/5fa97ca1759a4c83ab7e9c37c9cfbe79/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:09.834996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.838251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1390/2805] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:09.842991 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.909842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d07416-029d-41a1-aca3-778e7066f7b5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.914985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.915583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.915862 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.915980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c490-278b-489b-851f-372bf17d7997 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.916133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.916792 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.918475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.921038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.921639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.921914 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.922180 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.922804 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.924681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.928570 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1416/2806] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:09.932623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.942974 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca4d9e-3c01-4fa7-958b-ce3cd25ad583 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.948020 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c88a56-4fe4-48b4-9d8f-30ef4f2cb7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:09.948186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1391/2807] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:30:09.949443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c88a56-4fe4-48b4-9d8f-30ef4f2cb7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.949741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c88a56-4fe4-48b4-9d8f-30ef4f2cb7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.950037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c88a56-4fe4-48b4-9d8f-30ef4f2cb7cd admin admin] PATH_INFO: `/v3/projects/8517d42fabf0495a9eb503cd72cec867/users/5fa97ca1759a4c83ab7e9c37c9cfbe79/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:09.951971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c88a56-4fe4-48b4-9d8f-30ef4f2cb7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8517d42fabf0495a9eb503cd72cec867, user_id=5fa97ca1759a4c83ab7e9c37c9cfbe79, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:09.952859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:09.954601 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c88a56-4fe4-48b4-9d8f-30ef4f2cb7cd admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:09.962546 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a7cc3-a729-4370-9688-bc2106d60d6f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:09.966021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1417/2808] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:09 2022] PUT /identity/v3/projects/8517d42fabf0495a9eb503cd72cec867/users/5fa97ca1759a4c83ab7e9c37c9cfbe79/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:09.979026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:09.979309 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:09.979668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.008594 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] MFA Rules not processed for user `5fa97ca1759a4c83ab7e9c37c9cfbe79`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:10.009899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:10.010766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:10.024512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:10.025158 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.025434 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.025703 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.026337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:10.028484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:10.037824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:10.042040 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1392/2809] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:10.043376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:10.054241 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2bc5a-c700-4517-8077-d8b6f109cb9a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:10.060582 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:10.061222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.061502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.061844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.062515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:10.065225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:10.078058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1393/2810] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:10.082154 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:10.087599 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1418/2811] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:10.093187 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb506f-e513-4a21-88c4-10bb0497ff62 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:10.098111 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5efa27-f260-4bc3-81a2-90fc7722211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:10.098761 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5efa27-f260-4bc3-81a2-90fc7722211e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.099118 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5efa27-f260-4bc3-81a2-90fc7722211e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.099357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5efa27-f260-4bc3-81a2-90fc7722211e admin admin] PATH_INFO: `/v3/projects/a08c86da99bd47af83133919ed9f289b/users/069b17e051b845969c0534b8a6459bf2/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.100129 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:10.101526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:10.114818 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5efa27-f260-4bc3-81a2-90fc7722211e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08c86da99bd47af83133919ed9f289b, user_id=069b17e051b845969c0534b8a6459bf2, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:10.117625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5efa27-f260-4bc3-81a2-90fc7722211e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:10.131657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1394/2812] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:10 2022] PUT /identity/v3/projects/a08c86da99bd47af83133919ed9f289b/users/069b17e051b845969c0534b8a6459bf2/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:10.143799 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.144082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.144351 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.160936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e8061-e1eb-4156-84fe-b37fbda1f5db None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:10.172360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] MFA Rules not processed for user `069b17e051b845969c0534b8a6459bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:10.173685 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:10.211290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340947ab-8d46-4721-813e-c776131a8013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:10.212099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340947ab-8d46-4721-813e-c776131a8013 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.212479 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340947ab-8d46-4721-813e-c776131a8013 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.213059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340947ab-8d46-4721-813e-c776131a8013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.240258 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1395/2813] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:10.253438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:10.254837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:10.267183 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d29f88-b351-4d4c-a7e0-98ecb813fe33 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:10.270765 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:10.271358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.271628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.271893 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.280261 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:10.281687 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:10.282850 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340947ab-8d46-4721-813e-c776131a8013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:10.284268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340947ab-8d46-4721-813e-c776131a8013 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:10.290377 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1396/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:30:10.293945 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1419/2815] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:30:10.723018 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:10.793833 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5a8e5-1ed5-4ff3-9a12-b0b239fbd773 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:10.798733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:10.799357 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.799630 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.799897 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] PATH_INFO: `/v3/users/b8808cec13f74920b570fcb4ba4df940` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.801203 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8808cec13f74920b570fcb4ba4df940)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:10.803294 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:10.837624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:10.861257 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8808cec13f74920b570fcb4ba4df940'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:10.868742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8808cec13f74920b570fcb4ba4df940'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:10.869466 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8808cec13f74920b570fcb4ba4df940'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:10.870069 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8808cec13f74920b570fcb4ba4df940'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:10.880852 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8808cec13f74920b570fcb4ba4df940'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:10.900129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1397/2816] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:10 2022] DELETE /identity/v3/users/b8808cec13f74920b570fcb4ba4df940 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:10.905635 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:10.906058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:10.906270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:10.926706 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:10.927958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:10.958295 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:11.001183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1420/2817] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:11.011326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:11.013085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:11.086281 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6780-fbde-4679-ad72-daf7688f63b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:11.090578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:11.091205 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:11.091482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:11.091749 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:11.100607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:11.102042 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:11.112336 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1398/2818] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 12:30:11.386251 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:11.387717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:11.400833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6eef5-e32d-416f-94fb-196cc3fc6e99 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:11.406240 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:11.406861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:11.407137 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:11.407402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] PATH_INFO: `/v3/projects/9b912f826cda4972a27c4d6318be047c` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:11.408536 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b912f826cda4972a27c4d6318be047c)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:11.410550 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:11.458796 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b912f826cda4972a27c4d6318be047c', 'request_id': 'req-a3d4d986-07b7-4905-aba6-d1a129a61416'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.465684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b912f826cda4972a27c4d6318be047c', 'request_id': 'req-a3d4d986-07b7-4905-aba6-d1a129a61416'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.471741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b912f826cda4972a27c4d6318be047c', 'request_id': 'req-a3d4d986-07b7-4905-aba6-d1a129a61416'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.483649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] The token cache is being invalidate because project 9b912f826cda4972a27c4d6318be047c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:11.483930 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.484562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.486045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1421/2819] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:11 2022] DELETE /identity/v3/projects/9b912f826cda4972a27c4d6318be047c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:11.490027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:11.500284 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925c96f-55da-43e4-9a5e-5dd96cc24432 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:11.555378 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:11.556272 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:11.556885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:11.557318 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] PATH_INFO: `/v3/users/5fa97ca1759a4c83ab7e9c37c9cfbe79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:11.559400 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa97ca1759a4c83ab7e9c37c9cfbe79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:11.561410 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:11.609076 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa97ca1759a4c83ab7e9c37c9cfbe79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.611432 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:11.617773 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa97ca1759a4c83ab7e9c37c9cfbe79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.618667 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa97ca1759a4c83ab7e9c37c9cfbe79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.619634 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa97ca1759a4c83ab7e9c37c9cfbe79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.627250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-09c1be06-dea0-431c-94ba-fd6907965871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa97ca1759a4c83ab7e9c37c9cfbe79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:11.644125 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1399/2820] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:11 2022] DELETE /identity/v3/users/5fa97ca1759a4c83ab7e9c37c9cfbe79 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:11.928048 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:11.929537 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:11.943823 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4d986-07b7-4905-aba6-d1a129a61416 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.011955 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.012692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.012965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.013153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] PATH_INFO: `/v3/projects/8517d42fabf0495a9eb503cd72cec867` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.014467 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8517d42fabf0495a9eb503cd72cec867)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.016338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.063936 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8517d42fabf0495a9eb503cd72cec867', 'request_id': 'req-5a20b2fc-98e1-49a6-a153-c4e229c05670'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:12.069991 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8517d42fabf0495a9eb503cd72cec867', 'request_id': 'req-5a20b2fc-98e1-49a6-a153-c4e229c05670'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:12.071476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:12.077615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8517d42fabf0495a9eb503cd72cec867', 'request_id': 'req-5a20b2fc-98e1-49a6-a153-c4e229c05670'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:12.092875 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] The token cache is being invalidate because project 8517d42fabf0495a9eb503cd72cec867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:12.093164 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:12.093773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-5a20b2fc-98e1-49a6-a153-c4e229c05670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:12.095290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1422/2821] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:11 2022] DELETE /identity/v3/projects/8517d42fabf0495a9eb503cd72cec867 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:12.100167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.100478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.100966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.120700 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:12.122053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:12.189641 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1400/2822] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:12.197666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.198012 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.198998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.219190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:12.220640 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:12.229801 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1423/2823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:12.234196 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.244905 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713dfc5-c338-47c5-bad8-ea8831625ae9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.250760 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.251620 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.252015 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.252227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.253026 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:12.253393 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.255045 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.271142 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1401/2824] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:12.275535 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.286045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc6a4f-2f56-4989-8500-77255b00c22b None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.290645 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.291237 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.291516 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.291780 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.292978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.294848 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.322439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1424/2825] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:12.326611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.336422 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a3acb-fc73-40b8-8f3c-c34da585e5d1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.392952 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.393586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.393863 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.394133 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.394789 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.396979 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.419220 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1402/2826] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:12.423469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.434836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a6eba-c97d-43e1-a09e-3f1d20daf802 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.439663 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.440318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.440691 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.441065 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.441765 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.443441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.453710 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1425/2827] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:12.457640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.468198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e773386-2553-416d-9805-72007064e0ca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.472762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176fa4d-c932-4dde-a9a6-d877c9145321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.473372 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176fa4d-c932-4dde-a9a6-d877c9145321 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.473650 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176fa4d-c932-4dde-a9a6-d877c9145321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.473918 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176fa4d-c932-4dde-a9a6-d877c9145321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.474557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176fa4d-c932-4dde-a9a6-d877c9145321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.476117 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176fa4d-c932-4dde-a9a6-d877c9145321 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.487506 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1403/2828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:12.491551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.501515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4a14-885e-4783-95b5-65d641d2c9b4 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.506226 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.506861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.507131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.507399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] PATH_INFO: `/v3/projects/2127dfdce9cc40b3a379ed6a6403a1a4/users/aa5c7f6670234b22bc17fcc6e9d304a6/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.521795 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2127dfdce9cc40b3a379ed6a6403a1a4, user_id=aa5c7f6670234b22bc17fcc6e9d304a6, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.524407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.537831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1426/2829] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:12 2022] PUT /identity/v3/projects/2127dfdce9cc40b3a379ed6a6403a1a4/users/aa5c7f6670234b22bc17fcc6e9d304a6/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:12.549144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.549665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.549665 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.577577 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] MFA Rules not processed for user `aa5c7f6670234b22bc17fcc6e9d304a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:12.578709 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:12.598633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:12.644873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1404/2830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:12.649346 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.709778 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c721d97-b282-400f-80de-7c281fc4e122 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.714972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.715560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.715835 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.716100 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.716724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.718630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.745751 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1427/2831] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:12.750128 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.760561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a762393-9cf7-4ddb-aaa6-70620c2fc596 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.817698 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.818307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.818584 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.818849 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.819474 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.821643 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.844376 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1405/2832] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:12 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 12:30:12.848259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.859158 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed89af4-aa31-46b4-b396-e3ae0053da27 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.863771 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.864357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.864630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.864937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.865571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.867144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.877693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1428/2833] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:12.881817 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.891959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf31a-3b06-4f7f-997b-30927488d791 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.896450 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:12.897225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:12.897502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:12.897766 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] PATH_INFO: `/v3/projects/5d4c711a792348958ff9d0c7c7ba6c74/users/7a40d3b712d44d038635b017fe622a2f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:12.913003 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4c711a792348958ff9d0c7c7ba6c74, user_id=7a40d3b712d44d038635b017fe622a2f, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:12.915860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:12.929053 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1406/2834] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:12 2022] PUT /identity/v3/projects/5d4c711a792348958ff9d0c7c7ba6c74/users/7a40d3b712d44d038635b017fe622a2f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:12.933360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:12.943227 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468b52-ea4d-48ea-87cb-e8c4a323b412 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:12.990496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:13.000724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400466f3-37e7-4ba9-94fe-0c86832a390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:13.001356 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400466f3-37e7-4ba9-94fe-0c86832a390f admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:13.001630 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400466f3-37e7-4ba9-94fe-0c86832a390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:13.001896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400466f3-37e7-4ba9-94fe-0c86832a390f admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:13.002528 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400466f3-37e7-4ba9-94fe-0c86832a390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:13.004133 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400466f3-37e7-4ba9-94fe-0c86832a390f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:13.014466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1429/2835] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:13.018762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:13.029356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b457d-d53b-4951-af83-e61274efbf60 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:13.033912 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:13.034573 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:13.034844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:13.035106 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] PATH_INFO: `/v3/projects/5d4c711a792348958ff9d0c7c7ba6c74/users/7a40d3b712d44d038635b017fe622a2f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:13.037884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4c711a792348958ff9d0c7c7ba6c74, user_id=7a40d3b712d44d038635b017fe622a2f, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:13.040691 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:13.054041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1407/2836] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:13 2022] PUT /identity/v3/projects/5d4c711a792348958ff9d0c7c7ba6c74/users/7a40d3b712d44d038635b017fe622a2f/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:13.073859 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:13.074149 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:13.074434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:13.104560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] MFA Rules not processed for user `7a40d3b712d44d038635b017fe622a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:13.105816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:13.181812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1430/2837] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:13.195273 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:13.197684 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:13.271305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2276d-b62b-43b0-9b96-5a43a65da3ea admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:13.279409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:13.280078 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:13.280365 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:13.280607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:13.292009 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:13.293683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:13.303482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1408/2838] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:13.390080 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:13.400649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaa751-a571-418b-9714-14f741336f6a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:13.405233 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f65de7-ac96-46f5-9a22-51d4f0fae667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:13.405913 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65de7-ac96-46f5-9a22-51d4f0fae667 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:13.406234 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65de7-ac96-46f5-9a22-51d4f0fae667 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:13.406501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65de7-ac96-46f5-9a22-51d4f0fae667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:13.478655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65de7-ac96-46f5-9a22-51d4f0fae667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:13.480878 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f65de7-ac96-46f5-9a22-51d4f0fae667 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:13.490439 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1431/2839] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:15.418816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:15.420280 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:15.440594 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:15.488940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcae56-9e4e-4802-995d-b6268c758370 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:15.493461 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:15.494087 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:15.494363 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:15.494632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] PATH_INFO: `/v3/users/069b17e051b845969c0534b8a6459bf2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:15.496271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069b17e051b845969c0534b8a6459bf2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:15.498199 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:15.544060 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069b17e051b845969c0534b8a6459bf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:15.551660 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069b17e051b845969c0534b8a6459bf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:15.551806 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069b17e051b845969c0534b8a6459bf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:15.552356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069b17e051b845969c0534b8a6459bf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:15.560945 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069b17e051b845969c0534b8a6459bf2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:15.578096 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1409/2840] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:15 2022] DELETE /identity/v3/users/069b17e051b845969c0534b8a6459bf2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:15.582871 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:15.583364 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:15.583475 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:15.602631 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:15.603812 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:15.662781 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1432/2841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:15.673088 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:15.674478 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:15.731879 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b67a-4216-4623-a39e-0fbec43915f9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:15.735507 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:15.736103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:15.736379 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:15.736648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:15.745502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:15.746980 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:15.756305 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1410/2842] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:16.040271 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:16.041790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:16.054973 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7959-e07b-490c-9323-5cb08a414bfc None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:16.060120 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:16.060899 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:16.061182 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:16.061460 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] PATH_INFO: `/v3/projects/a08c86da99bd47af83133919ed9f289b` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:16.062707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08c86da99bd47af83133919ed9f289b)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:16.065016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:16.074560 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=100 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:16.114638 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08c86da99bd47af83133919ed9f289b', 'request_id': 'req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.121171 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08c86da99bd47af83133919ed9f289b', 'request_id': 'req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.126556 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08c86da99bd47af83133919ed9f289b', 'request_id': 'req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.140588 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] The token cache is being invalidate because project a08c86da99bd47af83133919ed9f289b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:16.140915 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.141515 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-44c7e817-9ab1-4bf4-9dd0-072a81c3379d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.142979 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1433/2843] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:16 2022] DELETE /identity/v3/projects/a08c86da99bd47af83133919ed9f289b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:16.295774 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:16.297560 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:16.313968 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e0df-921f-4e35-9739-44b5598f9ed1 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:16.359534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:16.385104 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:16.385566 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:16.386625 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:16.386904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] PATH_INFO: `/v3/users/aa5c7f6670234b22bc17fcc6e9d304a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:16.388121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5c7f6670234b22bc17fcc6e9d304a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:16.390162 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:16.442228 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5c7f6670234b22bc17fcc6e9d304a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.450243 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5c7f6670234b22bc17fcc6e9d304a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.450894 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5c7f6670234b22bc17fcc6e9d304a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.451490 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5c7f6670234b22bc17fcc6e9d304a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.458841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5c7f6670234b22bc17fcc6e9d304a6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:16.475928 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1411/2844] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:16 2022] DELETE /identity/v3/users/aa5c7f6670234b22bc17fcc6e9d304a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:16.480947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:16.481228 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:16.481495 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:16.501268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:16.502478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:16.562914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1434/2845] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:16.573974 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:16.575586 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:16.636543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f2564-5b87-449a-bd14-13f27fa6ae3b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:16.640271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:16.640873 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:16.641153 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:16.641415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:16.650330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:16.652191 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:16.661966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1412/2846] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:16.933517 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:16.934958 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:16.948762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f69ba0-e430-44a2-8a17-e4ae481e4c43 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:16.953543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:16.954181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:16.954494 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:16.954820 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] PATH_INFO: `/v3/projects/2127dfdce9cc40b3a379ed6a6403a1a4` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:16.955938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2127dfdce9cc40b3a379ed6a6403a1a4)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:16.957896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.005030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2127dfdce9cc40b3a379ed6a6403a1a4', 'request_id': 'req-008d3ac2-93a0-4b23-993f-515a5de3b5d7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.011126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2127dfdce9cc40b3a379ed6a6403a1a4', 'request_id': 'req-008d3ac2-93a0-4b23-993f-515a5de3b5d7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.016990 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2127dfdce9cc40b3a379ed6a6403a1a4', 'request_id': 'req-008d3ac2-93a0-4b23-993f-515a5de3b5d7'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.029953 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] The token cache is being invalidate because project 2127dfdce9cc40b3a379ed6a6403a1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:17.030238 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.030876 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.032357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1435/2847] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:16 2022] DELETE /identity/v3/projects/2127dfdce9cc40b3a379ed6a6403a1a4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:17.036512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:17.047398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dc8b7-14e0-488e-9694-3d4a318c40e7 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:17.102438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:17.102990 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.103266 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.103538 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] PATH_INFO: `/v3/users/7a40d3b712d44d038635b017fe622a2f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.105309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a40d3b712d44d038635b017fe622a2f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:17.107201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.109511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:17.155953 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a40d3b712d44d038635b017fe622a2f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.162981 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a40d3b712d44d038635b017fe622a2f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.163649 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a40d3b712d44d038635b017fe622a2f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.164252 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a40d3b712d44d038635b017fe622a2f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.172925 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c1efe60-bc67-48d2-bf38-1bcd5725bc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a40d3b712d44d038635b017fe622a2f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.189958 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1413/2848] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:17 2022] DELETE /identity/v3/users/7a40d3b712d44d038635b017fe622a2f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:17.461527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:17.463313 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:17.484671 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3ac2-93a0-4b23-993f-515a5de3b5d7 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:17.504037 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:17.550929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:17.551544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.551873 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.552145 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] PATH_INFO: `/v3/projects/5d4c711a792348958ff9d0c7c7ba6c74` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.553281 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4c711a792348958ff9d0c7c7ba6c74)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:17.555218 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.607415 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4c711a792348958ff9d0c7c7ba6c74', 'request_id': 'req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.615585 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4c711a792348958ff9d0c7c7ba6c74', 'request_id': 'req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.621485 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4c711a792348958ff9d0c7c7ba6c74', 'request_id': 'req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.634092 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] The token cache is being invalidate because project 5d4c711a792348958ff9d0c7c7ba6c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:17.634318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.634978 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-53a7ad8c-2f7c-4c73-9eb4-760ff5743642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:17.636590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1436/2849] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:17 2022] DELETE /identity/v3/projects/5d4c711a792348958ff9d0c7c7ba6c74 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:17.641983 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.642504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.642612 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.663811 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:17.665044 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:17.728816 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1414/2850] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:17.738030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.738378 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.738681 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.758938 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:17.760134 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:17.768383 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1437/2851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:17.772637 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:17.782920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffa7bb-8b99-4da4-be3b-8a1de81e46e4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:17.787343 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:17.787926 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.788198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.788463 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.789126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:17.789421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:17.790982 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.803957 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1415/2852] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:17.808366 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:17.817790 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9ef3-e962-460f-89e7-bfde37bd727a None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:17.822724 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:17.823315 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.823587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.823855 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.824474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:17.826407 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.855243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1438/2853] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:17 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:17.859561 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:17.869835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc9ba4-46e7-457f-88f2-7414554dfc18 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:17.926946 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:17.927549 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.927826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.928092 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.928705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:17.930900 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.947041 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:17.957904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1416/2854] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:17 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:17.959343 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:17.970431 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c1d3-8e08-4de6-8256-2bf979377680 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:17.975045 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:17.975626 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:17.975923 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:17.976183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:17.976838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:17.978441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:17.990466 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1439/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:17.994339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.004361 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1356-399b-4366-a83a-5db3674cdac6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.008948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbf448-674b-4733-851f-37d6ce4873be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.009540 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf448-674b-4733-851f-37d6ce4873be admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.009812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf448-674b-4733-851f-37d6ce4873be admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.010074 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf448-674b-4733-851f-37d6ce4873be admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.011469 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbf448-674b-4733-851f-37d6ce4873be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.013829 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbf448-674b-4733-851f-37d6ce4873be admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.024447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1417/2856] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:18.029455 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.039360 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1c1ec-c1c5-4f51-8267-0088517f4534 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.044026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.044661 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.044971 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.045241 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] PATH_INFO: `/v3/projects/3fbd05b34b1e4c80b1859c566fc075db/users/6f1362b793d64154ab6c93da46594bba/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.059669 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbd05b34b1e4c80b1859c566fc075db, user_id=6f1362b793d64154ab6c93da46594bba, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.062344 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.075717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1440/2857] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:18 2022] PUT /identity/v3/projects/3fbd05b34b1e4c80b1859c566fc075db/users/6f1362b793d64154ab6c93da46594bba/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:18.086846 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.087131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.087404 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.117417 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] MFA Rules not processed for user `6f1362b793d64154ab6c93da46594bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:18.118611 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:18.184230 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1418/2858] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:18.188673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.242459 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:18.258573 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ffb10-4fc7-4595-a963-28d0cbf2c857 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.263959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.264549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.264851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.265123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.265741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.267619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.294259 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1441/2859] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:18 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:18.298533 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.309672 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab636bd9-2e5f-43e8-9567-17cab1c4409c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.367269 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.367884 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.368167 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.368441 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.369103 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.371690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.394471 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1419/2860] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:18 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:18.398727 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.409760 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65e33b-2bc8-4c9f-935d-0fc6a120248f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.414476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.415069 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.415350 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.415624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.416266 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.418029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.428426 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1442/2861] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:18.434322 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.444308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe741-7e83-419c-93b8-df98cedea29c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.449845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.450491 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.450796 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.451067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] PATH_INFO: `/v3/projects/c797bfc2a0ec44c7a9ce012bd8194045/users/b12477f66b554203829c9c86c64bfc84/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.465729 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c797bfc2a0ec44c7a9ce012bd8194045, user_id=b12477f66b554203829c9c86c64bfc84, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.468385 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.480705 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1420/2862] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:18 2022] PUT /identity/v3/projects/c797bfc2a0ec44c7a9ce012bd8194045/users/b12477f66b554203829c9c86c64bfc84/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:18.484928 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.495418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c941dfb-5ec6-4b3f-85d7-c50e8ef84f77 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.551698 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7582e-a014-4c68-855e-c94d758e8b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.552834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7582e-a014-4c68-855e-c94d758e8b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.552834 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7582e-a014-4c68-855e-c94d758e8b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.553010 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7582e-a014-4c68-855e-c94d758e8b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.553544 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7582e-a014-4c68-855e-c94d758e8b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.555123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7582e-a014-4c68-855e-c94d758e8b26 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.566116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1443/2863] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:18.570366 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.584225 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3762ed7-1aff-4f20-a4a9-b4f980bc93de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.588960 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.589607 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.589883 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.590186 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] PATH_INFO: `/v3/projects/c797bfc2a0ec44c7a9ce012bd8194045/users/b12477f66b554203829c9c86c64bfc84/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.592063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c797bfc2a0ec44c7a9ce012bd8194045, user_id=b12477f66b554203829c9c86c64bfc84, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.594726 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.608483 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1421/2864] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:18 2022] PUT /identity/v3/projects/c797bfc2a0ec44c7a9ce012bd8194045/users/b12477f66b554203829c9c86c64bfc84/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:18.621892 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.622198 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.622447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.661664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] MFA Rules not processed for user `b12477f66b554203829c9c86c64bfc84`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:18.662925 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:18.737071 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1444/2865] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:18.748949 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.751038 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:18.788058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:18.817850 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ba93e-19a1-4710-98c3-fc906ad372f1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.821963 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.822617 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.822899 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.823319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.832481 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.833948 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.844276 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1422/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:18.900292 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:18.901819 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:18.914216 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399cb51-030a-4fe7-87ba-32f6de65b8e8 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:18.918504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13605a7-49dc-453e-b583-91bee1dc8335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:18.919099 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13605a7-49dc-453e-b583-91bee1dc8335 service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:18.919375 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13605a7-49dc-453e-b583-91bee1dc8335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:18.919649 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13605a7-49dc-453e-b583-91bee1dc8335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:18.962085 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:18.983075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13605a7-49dc-453e-b583-91bee1dc8335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:18.984583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13605a7-49dc-453e-b583-91bee1dc8335 service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:18.993680 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1445/2867] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:19.722001 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:19.723398 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:19.788574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902808d-615a-42b0-ace1-fe494b290577 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:19.797458 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:19.798126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:19.798402 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:19.798662 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] PATH_INFO: `/v3/users/d650fb334ee64d43ad47eb421f399e14` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:19.799812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d650fb334ee64d43ad47eb421f399e14)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:19.802319 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:19.850803 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd650fb334ee64d43ad47eb421f399e14'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:19.857696 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd650fb334ee64d43ad47eb421f399e14'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:19.858355 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd650fb334ee64d43ad47eb421f399e14'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:19.858955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd650fb334ee64d43ad47eb421f399e14'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:19.865802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd650fb334ee64d43ad47eb421f399e14'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:19.883860 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1423/2868] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:19 2022] DELETE /identity/v3/users/d650fb334ee64d43ad47eb421f399e14 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:19.888912 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:19.889194 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:19.889486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:19.908604 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:19.909842 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:19.970514 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1446/2869] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:19.981531 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:19.983029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:20.039674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7ccb-8338-4eea-a4f7-03eb4a2c2473 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:20.043728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:20.044374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:20.044669 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:20.044959 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:20.051072 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:20.055839 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:20.058904 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:20.068845 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1424/2870] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:20.337004 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:20.339345 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:20.352385 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6cafc-f23b-4b36-85e1-c97f69d6983e None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:20.357335 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:20.357959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:20.358261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:20.358831 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] PATH_INFO: `/v3/projects/7cf4b1d8c05947e88e4bb888f876cd78` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:20.359843 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf4b1d8c05947e88e4bb888f876cd78)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:20.373030 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:20.430055 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf4b1d8c05947e88e4bb888f876cd78', 'request_id': 'req-d6715427-8b78-4b19-aae2-62ad155517cc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:20.438274 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf4b1d8c05947e88e4bb888f876cd78', 'request_id': 'req-d6715427-8b78-4b19-aae2-62ad155517cc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:20.444552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf4b1d8c05947e88e4bb888f876cd78', 'request_id': 'req-d6715427-8b78-4b19-aae2-62ad155517cc'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:20.458954 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] The token cache is being invalidate because project 7cf4b1d8c05947e88e4bb888f876cd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:20.459243 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:20.459864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-d6715427-8b78-4b19-aae2-62ad155517cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:20.461524 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1447/2871] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:20 2022] DELETE /identity/v3/projects/7cf4b1d8c05947e88e4bb888f876cd78 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:22.355742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:22.357173 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:22.370207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957dcd2-d5a4-4b08-853f-c07c8fc0e4a9 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:22.425965 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:22.426588 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:22.426864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:22.427131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] PATH_INFO: `/v3/users/6f1362b793d64154ab6c93da46594bba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:22.428235 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1362b793d64154ab6c93da46594bba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:22.430148 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:22.475941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1362b793d64154ab6c93da46594bba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:22.483539 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1362b793d64154ab6c93da46594bba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:22.484237 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1362b793d64154ab6c93da46594bba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:22.484870 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1362b793d64154ab6c93da46594bba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:22.494421 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1362b793d64154ab6c93da46594bba'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:22.512440 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1425/2872] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:22 2022] DELETE /identity/v3/users/6f1362b793d64154ab6c93da46594bba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:22.517105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:22.517603 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:22.517705 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:22.536864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:22.538049 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:22.597116 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1448/2873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:22.607121 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:22.608809 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:22.666482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab7359-28df-4a49-a8d1-e8924abdb59b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:22.670185 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:22.670780 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:22.671057 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:22.671326 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:22.679976 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:22.681409 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:22.690543 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1426/2874] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:22.963948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:22.965449 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:22.975002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:22.979470 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2613a83-8d5a-4975-a045-f4bc38425199 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:22.986219 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:22.986995 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:22.987440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:22.987992 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] PATH_INFO: `/v3/projects/3fbd05b34b1e4c80b1859c566fc075db` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:22.989589 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbd05b34b1e4c80b1859c566fc075db)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:22.991898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.037562 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbd05b34b1e4c80b1859c566fc075db', 'request_id': 'req-0e94a088-85f5-4163-804c-d153aac86eff'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.044161 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbd05b34b1e4c80b1859c566fc075db', 'request_id': 'req-0e94a088-85f5-4163-804c-d153aac86eff'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.049752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbd05b34b1e4c80b1859c566fc075db', 'request_id': 'req-0e94a088-85f5-4163-804c-d153aac86eff'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.062242 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] The token cache is being invalidate because project 3fbd05b34b1e4c80b1859c566fc075db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:23.062519 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.063124 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.064620 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1449/2875] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:22 2022] DELETE /identity/v3/projects/3fbd05b34b1e4c80b1859c566fc075db => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:23.068624 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:23.078987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4685f-9a3f-4f7b-bb96-cca8fc2f787f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:23.090144 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:23.137797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:23.138356 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.138633 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.138903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] PATH_INFO: `/v3/users/b12477f66b554203829c9c86c64bfc84` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.140011 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12477f66b554203829c9c86c64bfc84)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:23.141955 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.187733 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12477f66b554203829c9c86c64bfc84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.194574 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12477f66b554203829c9c86c64bfc84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.195250 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12477f66b554203829c9c86c64bfc84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.195859 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12477f66b554203829c9c86c64bfc84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.204007 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5e6d3912-dd2a-4225-9b7f-6a570f925ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12477f66b554203829c9c86c64bfc84'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.221029 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1427/2876] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:23 2022] DELETE /identity/v3/users/b12477f66b554203829c9c86c64bfc84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:23.490260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:23.491822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:23.505707 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94a088-85f5-4163-804c-d153aac86eff admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:23.564489 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:23.565224 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.565501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.565770 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] PATH_INFO: `/v3/projects/c797bfc2a0ec44c7a9ce012bd8194045` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.566943 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c797bfc2a0ec44c7a9ce012bd8194045)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:23.569034 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.616468 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c797bfc2a0ec44c7a9ce012bd8194045', 'request_id': 'req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.622927 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c797bfc2a0ec44c7a9ce012bd8194045', 'request_id': 'req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.628337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c797bfc2a0ec44c7a9ce012bd8194045', 'request_id': 'req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.640323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] The token cache is being invalidate because project c797bfc2a0ec44c7a9ce012bd8194045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:23.640624 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.641253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-48d87d6a-77a6-4f6c-a6d6-32a0376eb384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:23.642722 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1450/2877] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:23 2022] DELETE /identity/v3/projects/c797bfc2a0ec44c7a9ce012bd8194045 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:23.647647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.648132 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.648239 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.669599 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:23.670732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:23.728160 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1428/2878] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:23.736583 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.736896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.737167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.756659 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:23.757879 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:23.765898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1451/2879] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:23.770224 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:23.780678 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdb484-99fb-4c0f-bab1-08564f4d9488 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:23.785373 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:23.785966 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.786242 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.786512 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.787151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:23.787447 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:23.789107 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.801962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1429/2880] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:23.806311 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:23.815622 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037f84d-5b08-4306-9668-668f445cb337 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:23.820291 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:23.821152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.821437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.821704 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.822323 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:23.824367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.833776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:23.853825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1452/2881] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:23 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:23.858671 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:23.868614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7ef7-9b38-42ea-8d52-1d3a5e10b9e9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:23.887330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:23.929339 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:23.929864 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.930140 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.930408 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.931034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:23.933056 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.954757 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1430/2882] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:23 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:23.958521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:23.969329 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d409cd5-45ac-45d6-83ba-efaa0e6e9d58 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:23.973932 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:23.974511 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:23.974788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:23.975059 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:23.975697 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:23.977501 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:23.988591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1453/2883] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:23.992891 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.002973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d7a5-cb1d-4da5-8644-ae84eaf073af admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.007479 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7c9ec-416b-433c-85c1-8481529facd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.008063 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7c9ec-416b-433c-85c1-8481529facd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.008337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7c9ec-416b-433c-85c1-8481529facd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.008602 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7c9ec-416b-433c-85c1-8481529facd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.009291 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7c9ec-416b-433c-85c1-8481529facd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.011436 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7c9ec-416b-433c-85c1-8481529facd5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.021828 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1431/2884] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:24.026486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.036264 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1094-2034-445a-a64e-dc8a512dd563 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.040897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.041533 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.041813 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.042076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] PATH_INFO: `/v3/projects/d53d8cdfd42442748a13d22e5b94e3dd/users/e89406ca9137433fa3c139c1fa6ce751/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.056723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53d8cdfd42442748a13d22e5b94e3dd, user_id=e89406ca9137433fa3c139c1fa6ce751, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.059399 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.074764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1454/2885] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:24 2022] PUT /identity/v3/projects/d53d8cdfd42442748a13d22e5b94e3dd/users/e89406ca9137433fa3c139c1fa6ce751/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:24.085837 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.086116 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.086390 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.114964 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] MFA Rules not processed for user `e89406ca9137433fa3c139c1fa6ce751`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:24.116264 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:24.179511 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1432/2886] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:24.184126 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.245044 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af948-76b0-4c08-a7a5-ebb6286b6af9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.249619 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.250202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.250474 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.250739 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.251633 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.253541 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.279837 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1455/2887] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:24 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:24.283917 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.294430 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d9a08-5033-4543-9216-53b5523a6d56 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.352920 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.353519 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.353938 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.354207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.354827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.356702 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.377668 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1433/2888] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:24 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:24.381664 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.392363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef1ee-0b2c-4488-8e7d-6354d3c13251 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.396869 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.397447 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.397718 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.397982 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.398611 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.400189 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.411293 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1456/2889] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:24.415647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.425876 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd99fa-6ef8-4086-ac60-871694160630 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.430593 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698512d6-c1e6-4605-b065-04f701b8865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.431420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698512d6-c1e6-4605-b065-04f701b8865e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.431523 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698512d6-c1e6-4605-b065-04f701b8865e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.432428 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698512d6-c1e6-4605-b065-04f701b8865e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.432940 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698512d6-c1e6-4605-b065-04f701b8865e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.435068 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698512d6-c1e6-4605-b065-04f701b8865e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.447080 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1434/2890] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:24.452261 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.462256 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1ec4f-e99b-4e02-af20-87a344b790ce admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.467469 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.468105 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.468376 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.468644 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] PATH_INFO: `/v3/projects/0b6f5cfc401b4f7ebefc71ff0122077c/users/b4c2070f7c424f009442d8fa246991c3/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.482833 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6f5cfc401b4f7ebefc71ff0122077c, user_id=b4c2070f7c424f009442d8fa246991c3, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.485476 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.498300 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1457/2891] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:24 2022] PUT /identity/v3/projects/0b6f5cfc401b4f7ebefc71ff0122077c/users/b4c2070f7c424f009442d8fa246991c3/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:24.508414 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.508690 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.508985 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.529526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:24.539865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] MFA Rules not processed for user `b4c2070f7c424f009442d8fa246991c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:24.541105 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:24.603719 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1435/2892] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:24.608676 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.671552 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c20fe9-0583-4349-a8f7-58cd18d68ed9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.676174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.676793 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.677070 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.677338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.677967 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.679851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.689488 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:24.708187 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1458/2893] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:24 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:24.712337 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.722841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae655c3-a47e-4796-8e69-0aeb18d6c711 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.777911 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.778621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.778885 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.779157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.779783 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.781723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.802754 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1436/2894] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:24 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:24.806758 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.818321 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f784e-ab4c-4b4d-8c0e-a86c9459a95f admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.823548 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.824131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.824402 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.824666 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.825342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.826914 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.836937 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1459/2895] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 12:30:24.841389 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.851188 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75d7df-51f3-46ae-88e0-92d5e1c0d0db admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.856324 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.856994 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.857548 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.857819 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] PATH_INFO: `/v3/projects/1dff6ad48c854c96bb5eb9ac3a1a2449/users/42d7cb42fe784e1992b44d9f9c203dc9/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.872865 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dff6ad48c854c96bb5eb9ac3a1a2449, user_id=42d7cb42fe784e1992b44d9f9c203dc9, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.875827 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.888962 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1437/2896] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:24 2022] PUT /identity/v3/projects/1dff6ad48c854c96bb5eb9ac3a1a2449/users/42d7cb42fe784e1992b44d9f9c203dc9/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:24.892880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.903408 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4d93-0b51-4151-bcd7-db20e6131a4a admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.960726 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883c854-1f04-4dd5-b2cc-78336072102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.961276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883c854-1f04-4dd5-b2cc-78336072102b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.961546 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883c854-1f04-4dd5-b2cc-78336072102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.961811 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883c854-1f04-4dd5-b2cc-78336072102b admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.962434 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883c854-1f04-4dd5-b2cc-78336072102b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:24.964016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883c854-1f04-4dd5-b2cc-78336072102b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:24.974040 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1460/2897] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:24.978271 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:24.989251 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4f11-3c7c-42ad-a176-d1aaa574ee22 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:24.993848 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:24.995172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:24.995509 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:24.995802 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] PATH_INFO: `/v3/projects/1dff6ad48c854c96bb5eb9ac3a1a2449/users/42d7cb42fe784e1992b44d9f9c203dc9/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:24.997707 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dff6ad48c854c96bb5eb9ac3a1a2449, user_id=42d7cb42fe784e1992b44d9f9c203dc9, role_id=50bac7f4cb274a4c9dbf8eef1d46a6c5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:25.000288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:25.010207 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1438/2898] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:24 2022] PUT /identity/v3/projects/1dff6ad48c854c96bb5eb9ac3a1a2449/users/42d7cb42fe784e1992b44d9f9c203dc9/roles/50bac7f4cb274a4c9dbf8eef1d46a6c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:25.020275 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308753d-c88c-497c-b763-353542aff402 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:25.020558 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308753d-c88c-497c-b763-353542aff402 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:25.020874 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308753d-c88c-497c-b763-353542aff402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:25.048948 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-6308753d-c88c-497c-b763-353542aff402 None None] MFA Rules not processed for user `42d7cb42fe784e1992b44d9f9c203dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:25.050183 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6308753d-c88c-497c-b763-353542aff402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:25.119521 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1461/2899] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:25.131591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:25.133309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:25.190901 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c20cb5-066a-49f4-903e-0f6e37912fdc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:25.194535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:25.195131 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:25.195407 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:25.195674 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:25.201888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:25.206034 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:25.208197 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:25.218648 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1439/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:25.724002 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308753d-c88c-497c-b763-353542aff402 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:25.725381 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-6308753d-c88c-497c-b763-353542aff402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:25.737421 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308753d-c88c-497c-b763-353542aff402 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:25.740896 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:25.741486 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:25.741761 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:25.742029 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:25.799342 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:25.800898 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:25.804353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:25.811891 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1462/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:29.826564 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:29.835358 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1e74-801a-4c1e-951c-b0ad131d1187 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:29.839580 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34ccde-06f1-4232-b470-9fc2f4c53085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:29.840166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34ccde-06f1-4232-b470-9fc2f4c53085 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:29.840443 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34ccde-06f1-4232-b470-9fc2f4c53085 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:29.840712 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34ccde-06f1-4232-b470-9fc2f4c53085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:29.895971 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34ccde-06f1-4232-b470-9fc2f4c53085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:29.897360 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34ccde-06f1-4232-b470-9fc2f4c53085 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:29.906875 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1440/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:32.156175 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:32.219443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda613b6-8403-4499-8ec5-32e089fcd86d service cinder] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:32.223950 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:32.224553 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:32.224911 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:32.225181 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] PATH_INFO: `/v3/users/e89406ca9137433fa3c139c1fa6ce751` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:32.226317 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89406ca9137433fa3c139c1fa6ce751)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:32.228880 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:32.275163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89406ca9137433fa3c139c1fa6ce751'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.275824 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89406ca9137433fa3c139c1fa6ce751'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.276441 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89406ca9137433fa3c139c1fa6ce751'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.283123 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89406ca9137433fa3c139c1fa6ce751'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.290058 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89406ca9137433fa3c139c1fa6ce751'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.308262 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1463/2903] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:32 2022] DELETE /identity/v3/users/e89406ca9137433fa3c139c1fa6ce751 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:32.312737 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:32.313208 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:32.313307 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:32.332049 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:32.333387 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:32.390847 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1441/2904] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:32.400643 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:32.402072 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:32.458109 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95941b-0d9f-47c4-b7b6-1cfd8cee8f08 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:32.461791 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:32.462382 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:32.462672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:32.462924 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:32.471806 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:32.473206 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:32.483169 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1464/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:32.752614 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:32.754166 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:32.766297 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad965ea-8fae-4e52-baa7-fa24652c2967 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:32.771502 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:32.772150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:32.772427 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:32.772701 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] PATH_INFO: `/v3/projects/d53d8cdfd42442748a13d22e5b94e3dd` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:32.774073 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53d8cdfd42442748a13d22e5b94e3dd)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:32.776578 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:32.827123 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53d8cdfd42442748a13d22e5b94e3dd', 'request_id': 'req-7b9e007e-d796-45da-8bde-3a60246690ea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.834725 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53d8cdfd42442748a13d22e5b94e3dd', 'request_id': 'req-7b9e007e-d796-45da-8bde-3a60246690ea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.841973 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53d8cdfd42442748a13d22e5b94e3dd', 'request_id': 'req-7b9e007e-d796-45da-8bde-3a60246690ea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.852067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] The token cache is being invalidate because project d53d8cdfd42442748a13d22e5b94e3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:32.852353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.853013 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.855055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1442/2906] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:32 2022] DELETE /identity/v3/projects/d53d8cdfd42442748a13d22e5b94e3dd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:32.859128 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:32.869026 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224983-fead-4fed-af30-f270106324a2 service neutron] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:32.885549 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:32.926985 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:32.927608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:32.927883 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:32.928152 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] PATH_INFO: `/v3/users/b4c2070f7c424f009442d8fa246991c3` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:32.929290 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c2070f7c424f009442d8fa246991c3)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:32.931195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:32.977009 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c2070f7c424f009442d8fa246991c3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.977655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c2070f7c424f009442d8fa246991c3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.978882 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c2070f7c424f009442d8fa246991c3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.985851 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c2070f7c424f009442d8fa246991c3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:32.993140 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c2070f7c424f009442d8fa246991c3'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.010437 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1465/2907] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:32 2022] DELETE /identity/v3/users/b4c2070f7c424f009442d8fa246991c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:33.274260 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:33.275978 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:33.289742 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e007e-d796-45da-8bde-3a60246690ea admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:33.302236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:33.350779 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:33.351425 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:33.351666 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:33.351937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] PATH_INFO: `/v3/projects/0b6f5cfc401b4f7ebefc71ff0122077c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:33.353058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6f5cfc401b4f7ebefc71ff0122077c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:33.355681 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:33.402723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6f5cfc401b4f7ebefc71ff0122077c', 'request_id': 'req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.409728 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6f5cfc401b4f7ebefc71ff0122077c', 'request_id': 'req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.415786 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6f5cfc401b4f7ebefc71ff0122077c', 'request_id': 'req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.426438 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] The token cache is being invalidate because project 0b6f5cfc401b4f7ebefc71ff0122077c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:33.426723 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.427348 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.428841 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1443/2908] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:33 2022] DELETE /identity/v3/projects/0b6f5cfc401b4f7ebefc71ff0122077c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:33.433438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:33.434826 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:33.448729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00151686-b5f6-4f9c-9477-c843cb161fa9 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:33.503284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:33.503900 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:33.504174 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:33.504440 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] PATH_INFO: `/v3/users/42d7cb42fe784e1992b44d9f9c203dc9` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:33.505571 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d7cb42fe784e1992b44d9f9c203dc9)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:33.507471 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:33.547322 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:33.553176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d7cb42fe784e1992b44d9f9c203dc9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.554031 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d7cb42fe784e1992b44d9f9c203dc9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.555265 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d7cb42fe784e1992b44d9f9c203dc9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.563703 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d7cb42fe784e1992b44d9f9c203dc9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.570684 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ada3c858-94bb-4b34-b736-5ea6ef12cc71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d7cb42fe784e1992b44d9f9c203dc9'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.588564 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1466/2909] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:33 2022] DELETE /identity/v3/users/42d7cb42fe784e1992b44d9f9c203dc9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 12:30:33.860288 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:33.861739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:33.877075 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e8769-0fe6-4941-b3c4-6cf647e434f2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:33.935313 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:33.935947 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:33.936227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:33.936504 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] PATH_INFO: `/v3/projects/1dff6ad48c854c96bb5eb9ac3a1a2449` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:33.937652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dff6ad48c854c96bb5eb9ac3a1a2449)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:33.939535 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:33.985181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:33.986530 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dff6ad48c854c96bb5eb9ac3a1a2449', 'request_id': 'req-02c97f62-47c7-4999-abb6-d34a18b3f2bb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:33.996022 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dff6ad48c854c96bb5eb9ac3a1a2449', 'request_id': 'req-02c97f62-47c7-4999-abb6-d34a18b3f2bb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:34.002639 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dff6ad48c854c96bb5eb9ac3a1a2449', 'request_id': 'req-02c97f62-47c7-4999-abb6-d34a18b3f2bb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:34.012686 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] The token cache is being invalidate because project 1dff6ad48c854c96bb5eb9ac3a1a2449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:34.012998 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:34.013615 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-02c97f62-47c7-4999-abb6-d34a18b3f2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:34.015085 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1444/2910] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:33 2022] DELETE /identity/v3/projects/1dff6ad48c854c96bb5eb9ac3a1a2449 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:34.021861 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.022142 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.022411 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.042690 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:34.043868 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:34.104836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1467/2911] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:34.113286 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.113565 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.113835 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.132736 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:34.133937 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:34.141746 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1445/2912] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:34.145768 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.155729 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c807c4-bfac-4689-8198-50ee366604f1 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.160186 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.160764 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.161067 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.161337 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.161965 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:34.162255 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.163825 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.175610 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1468/2913] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 12:30:34.179826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.188939 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76961ef-0bfa-4e78-a2ea-0d27d7a93c64 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.193526 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.194150 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.194476 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.194745 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.195374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.197558 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.224513 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1446/2914] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:34 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:34.229453 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.239763 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2230-d549-4416-8cb1-1196792b7908 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.297972 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.298655 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.298998 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.299527 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.300017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.301996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.324607 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1469/2915] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:34 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:34.328437 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.340553 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba299e-4a99-4cd4-88ca-f25bf6ccd489 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.345344 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.345995 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.346415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.346689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.347330 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.348987 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.359279 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1447/2916] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:34.363279 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.374153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e96da-93d4-4e8a-afe8-fe75038c63e5 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.378773 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06b6c-cb68-45de-9e1e-0baf994654ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.379361 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06b6c-cb68-45de-9e1e-0baf994654ac admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.379636 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06b6c-cb68-45de-9e1e-0baf994654ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.379901 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06b6c-cb68-45de-9e1e-0baf994654ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.380538 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06b6c-cb68-45de-9e1e-0baf994654ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.382285 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06b6c-cb68-45de-9e1e-0baf994654ac admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.393377 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1470/2917] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:34.397591 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.410157 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc60be-ddc6-4ffe-9943-bb313e2d65eb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.419950 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.420172 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.420282 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.420954 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] PATH_INFO: `/v3/projects/ee90e5ce8bcf4b6aaad2943ac5ae6403/users/b88de252d55c4c49950ca611f652f771/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.438910 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee90e5ce8bcf4b6aaad2943ac5ae6403, user_id=b88de252d55c4c49950ca611f652f771, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.441663 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.455595 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1448/2918] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:34 2022] PUT /identity/v3/projects/ee90e5ce8bcf4b6aaad2943ac5ae6403/users/b88de252d55c4c49950ca611f652f771/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:34.466814 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.467318 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.467423 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.496769 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] MFA Rules not processed for user `b88de252d55c4c49950ca611f652f771`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:34.497988 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:34.510298 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:34.567853 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1471/2919] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:34.581151 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:34.582941 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:34.643296 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af231a-c024-4d8b-b02b-213be2e27c52 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:34.646921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30c111-2be5-4677-b5d9-a860164471f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83cabf530a454894816fbc457fa9a808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:34.647522 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30c111-2be5-4677-b5d9-a860164471f7 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:34.647794 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30c111-2be5-4677-b5d9-a860164471f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:34.648058 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30c111-2be5-4677-b5d9-a860164471f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:34.658209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30c111-2be5-4677-b5d9-a860164471f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:34.659632 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30c111-2be5-4677-b5d9-a860164471f7 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:34.669621 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1449/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:44.564944 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=21 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:44.664451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:50.229816 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:50.335530 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cca01-f2b7-45cf-93bd-828ad3c70a06 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:50.340202 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:50.341367 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:50.341632 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:50.341895 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] PATH_INFO: `/v3/users/b88de252d55c4c49950ca611f652f771` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:50.343021 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88de252d55c4c49950ca611f652f771)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:50.344961 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:50.391629 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88de252d55c4c49950ca611f652f771'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:50.392270 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88de252d55c4c49950ca611f652f771'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:50.392908 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88de252d55c4c49950ca611f652f771'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:50.400076 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88de252d55c4c49950ca611f652f771'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:50.407694 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88de252d55c4c49950ca611f652f771'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:50.425509 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1472/2921] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:30:50 2022] DELETE /identity/v3/users/b88de252d55c4c49950ca611f652f771 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:50.430025 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:50.430534 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:50.430657 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:50.480555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:50.482004 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:50.539664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1450/2922] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:50.549836 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:50.551207 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:50.592357 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:50.625138 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffae14-953b-4bd1-abee-3f4b3e5bb4ee admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:50.628735 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb9fb7-92df-477f-918f-077474445ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:50.629363 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb9fb7-92df-477f-918f-077474445ced service neutron] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:50.629639 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb9fb7-92df-477f-918f-077474445ced service neutron] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:50.629907 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb9fb7-92df-477f-918f-077474445ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:50.639273 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb9fb7-92df-477f-918f-077474445ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:50.640692 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb9fb7-92df-477f-918f-077474445ced service neutron] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:50.649863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1473/2923] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:50.914378 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:50.915812 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:50.928419 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a00ae0-c4e8-43c1-a090-878a3ab6e399 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:50.934903 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:50.935762 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:50.936135 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:50.936532 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] PATH_INFO: `/v3/projects/ee90e5ce8bcf4b6aaad2943ac5ae6403` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:50.937797 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee90e5ce8bcf4b6aaad2943ac5ae6403)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:50.940109 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:50.987722 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee90e5ce8bcf4b6aaad2943ac5ae6403', 'request_id': 'req-7a685957-d64e-4100-a65a-e623d5053096'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:50.994423 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee90e5ce8bcf4b6aaad2943ac5ae6403', 'request_id': 'req-7a685957-d64e-4100-a65a-e623d5053096'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:51.001315 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee90e5ce8bcf4b6aaad2943ac5ae6403', 'request_id': 'req-7a685957-d64e-4100-a65a-e623d5053096'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:51.011579 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] The token cache is being invalidate because project ee90e5ce8bcf4b6aaad2943ac5ae6403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:30:51.011871 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:51.012680 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a685957-d64e-4100-a65a-e623d5053096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:30:51.014214 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1451/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:30:50 2022] DELETE /identity/v3/projects/ee90e5ce8bcf4b6aaad2943ac5ae6403 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:51.018997 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.019276 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.019543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.068053 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:51.069268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:51.127672 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1474/2925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:51.189763 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.190027 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.190303 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.210482 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:51.211670 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:51.220328 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1452/2926] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:51.224656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.234591 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155368d9-4bf2-4de6-8bf4-8fe05bcc93a4 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.239077 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.239656 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.239929 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.240195 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] PATH_INFO: `/v3/domains` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.240864 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 12:30:51.241162 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.242752 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.254762 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1475/2927] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 28 12:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 12:30:51.258820 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.268488 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c21d43-d474-4529-87cf-6b8d1199aff1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.273317 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.273916 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.274181 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.274451 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.275071 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.277023 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.304480 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1453/2928] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 28 12:30:51 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:51.308788 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.319252 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43319c-cd2e-466c-be4f-ea7866b1c72b admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.376545 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.377159 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.377432 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.377693 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] PATH_INFO: `/v3/users` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.378297 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.380176 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.402066 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1476/2929] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 28 12:30:51 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 12:30:51.405683 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.415640 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7616fa-5b07-4ba6-8455-39fa06f4f5ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.420420 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.421037 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.421312 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.421575 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.422201 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.423758 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.433308 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1454/2930] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:51.437732 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.447841 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501a9f8-d594-45f3-9a96-4a6e9d7a7697 admin admin] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.453190 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1abd34-263a-4863-9eca-ba16412d850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.453776 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1abd34-263a-4863-9eca-ba16412d850d admin admin] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.454054 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1abd34-263a-4863-9eca-ba16412d850d admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.454320 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1abd34-263a-4863-9eca-ba16412d850d admin admin] PATH_INFO: `/v3/roles` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.454959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1abd34-263a-4863-9eca-ba16412d850d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.456526 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1abd34-263a-4863-9eca-ba16412d850d admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.467615 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1477/2931] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 28 12:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 12:30:51.471628 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.482395 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f477d3-38a5-43e4-8702-7ef974ac3546 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.486921 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.487555 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.487826 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.488091 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] PATH_INFO: `/v3/projects/2ebb741220af4b4ab0b348ec331bd639/users/c19ccaf3ce6e417ab0583305ba18d1ef/roles/a48e85fe9e11432b80cd16193d4069d6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.503309 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebb741220af4b4ab0b348ec331bd639, user_id=c19ccaf3ce6e417ab0583305ba18d1ef, role_id=a48e85fe9e11432b80cd16193d4069d6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.506094 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.508161 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:51.521198 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1455/2932] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 28 12:30:51 2022] PUT /identity/v3/projects/2ebb741220af4b4ab0b348ec331bd639/users/c19ccaf3ce6e417ab0583305ba18d1ef/roles/a48e85fe9e11432b80cd16193d4069d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:30:51.526260 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934aaf2-c661-4e68-87e1-13bd0c1843d7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.526539 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934aaf2-c661-4e68-87e1-13bd0c1843d7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.526807 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934aaf2-c661-4e68-87e1-13bd0c1843d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.540416 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:51.547268 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-4934aaf2-c661-4e68-87e1-13bd0c1843d7 None None] MFA Rules not processed for user `b23092081c294ccc9f338033bf5ecc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:51.548478 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-4934aaf2-c661-4e68-87e1-13bd0c1843d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:51.605388 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1478/2933] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:30:51.616223 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:51.617992 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:51.674100 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ad864-0553-418d-8544-e24b438e43e8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:51.677647 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31cab6d1bf8e41c49643a3f80c7703f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:51.678236 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:51.678508 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:51.678770 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:51.688209 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:51.689636 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:51.699017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1456/2934] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:52.312863 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a683-6c93-4615-8598-ceb1983f64f7 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:52.313338 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a683-6c93-4615-8598-ceb1983f64f7 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:52.313438 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a683-6c93-4615-8598-ceb1983f64f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:52.342418 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-ecd7a683-6c93-4615-8598-ceb1983f64f7 None None] MFA Rules not processed for user `c19ccaf3ce6e417ab0583305ba18d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:52.343608 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-ecd7a683-6c93-4615-8598-ceb1983f64f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:52.409865 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1479/2935] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:30:52.421067 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:30:52.422439 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:52.479542 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0da6cc-178d-4b78-ba32-c23d258b4e8b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:30:52.484046 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e128e6-d439-477f-bdd7-9af339e58e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68ebccd64bc49d8a6c6d05d50ce2b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:30:52.484645 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e128e6-d439-477f-bdd7-9af339e58e30 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:52.484961 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e128e6-d439-477f-bdd7-9af339e58e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:52.485231 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e128e6-d439-477f-bdd7-9af339e58e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:52.493769 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e128e6-d439-477f-bdd7-9af339e58e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:30:52.495129 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e128e6-d439-477f-bdd7-9af339e58e30 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:30:52.504732 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1457/2936] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:30:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:30:53.862289 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] REQUEST_METHOD: `POST` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:30:53.862838 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:30:53.862947 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:30:53.882748 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.auth.core [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] MFA Rules not processed for user `c19ccaf3ce6e417ab0583305ba18d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:30:53.883933 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:30:53.891496 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1480/2937] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:31:02.500652 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=1,keystone:SELECT=54 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:03.877332 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=59 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:06.663909 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eede8-f741-4432-b62e-c15268db4aa2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:06.664353 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eede8-f741-4432-b62e-c15268db4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:06.664515 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032eede8-f741-4432-b62e-c15268db4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:06.687306 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-032eede8-f741-4432-b62e-c15268db4aa2 None None] MFA Rules not processed for user `c19ccaf3ce6e417ab0583305ba18d1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:31:06.688484 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-032eede8-f741-4432-b62e-c15268db4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:31:06.695456 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1458/2938] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 28 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:31:16.681571 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:22.040443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:31:22.042668 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:31:22.130005 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39726e0c-24a5-4028-8ee9-0d2774171fc9 None None] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:31:22.135017 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb077a5cb994974a54ee83240ddb0b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:31:22.135798 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:22.136075 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:22.136353 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:22.138253 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:31:22.149723 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:31:22.151897 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:31:22.161993 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1481/2939] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 28 12:31:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 12:31:25.096888 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8d589-2ddc-4257-bde3-548976a98d64 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:25.097354 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8d589-2ddc-4257-bde3-548976a98d64 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:25.097465 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8d589-2ddc-4257-bde3-548976a98d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:25.128055 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2ea8d589-2ddc-4257-bde3-548976a98d64 None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:31:25.129689 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ea8d589-2ddc-4257-bde3-548976a98d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:31:25.194494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1459/2940] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 28 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 12:31:25.241144 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:31:25.242543 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.fernet_utils [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:31:25.316131 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfa94c-a3dc-43fa-958b-a63a5155d9b1 service placement] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:31:25.321414 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:31:25.322008 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:25.322283 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:25.323156 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:25.331153 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:31:25.332717 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:31:25.341073 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1482/2941] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:31:35.188494 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=32 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:35.337551 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=73 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:39.742658 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:39.743126 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:39.743227 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:39.763175 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] MFA Rules not processed for user `586cf4918eee4d13be7cc1adc56d8128`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 12:31:39.764374 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 12:31:39.771557 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1460/2942] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 28 12:31:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 12:31:39.784163 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:31:39.794822 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ea3e-bf04-4bf1-bb88-19c82c2800f2 service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:31:39.799996 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f582fce261d42b185ad05f699cf1f00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c3be15a2b6747e6a0e1d5a70183bae3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:31:39.800590 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] REQUEST_METHOD: `GET` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:39.801013 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:39.801284 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:39.810016 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:31:39.811623 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:31:39.819917 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1483/2943] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 28 12:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 12:31:41.733222 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:31:41.744739 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e52ba-156e-4fd7-a87f-54d42d634dfb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:31:41.749664 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:31:41.750341 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:41.750676 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:41.750844 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] PATH_INFO: `/v3/users/c19ccaf3ce6e417ab0583305ba18d1ef` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:41.752032 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19ccaf3ce6e417ab0583305ba18d1ef)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:31:41.753887 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:31:41.803263 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19ccaf3ce6e417ab0583305ba18d1ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:41.810415 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19ccaf3ce6e417ab0583305ba18d1ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:41.811082 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19ccaf3ce6e417ab0583305ba18d1ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:41.811675 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19ccaf3ce6e417ab0583305ba18d1ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:41.819017 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2976952-e856-45a5-bd89-b0ca53aafe41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19ccaf3ce6e417ab0583305ba18d1ef'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:41.837332 dv-cinder-844563-9-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1461/2944] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 28 12:31:41 2022] DELETE /identity/v3/users/c19ccaf3ce6e417ab0583305ba18d1ef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:31:42.008443 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] Authenticating user token {{(pid=81473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 12:31:42.028504 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4577-62bd-4c18-a731-ca0d52fa54fe service swift] Validating token access rules against request {{(pid=81473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 12:31:42.085688 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b23092081c294ccc9f338033bf5ecc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ec0cb5de3946ab8e99e7fe425ccea6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 12:31:42.086308 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 12:31:42.086587 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 12:31:42.086856 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] PATH_INFO: `/v3/projects/2ebb741220af4b4ab0b348ec331bd639` {{(pid=81473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 12:31:42.087959 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebb741220af4b4ab0b348ec331bd639)` {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 12:31:42.090052 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] RBAC: Authorization granted {{(pid=81473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 12:31:42.134977 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebb741220af4b4ab0b348ec331bd639', 'request_id': 'req-ab987326-524c-4777-a31e-8b7b8cd81a28'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:42.142147 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebb741220af4b4ab0b348ec331bd639', 'request_id': 'req-ab987326-524c-4777-a31e-8b7b8cd81a28'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:42.147919 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebb741220af4b4ab0b348ec331bd639', 'request_id': 'req-ab987326-524c-4777-a31e-8b7b8cd81a28'} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:42.159741 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] The token cache is being invalidate because project 2ebb741220af4b4ab0b348ec331bd639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 12:31:42.160027 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:42.160673 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG keystone.notifications [None req-ab987326-524c-4777-a31e-8b7b8cd81a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 12:31:42.162167 dv-cinder-844563-9-smb devstack@keystone.service[81473]: [pid: 81473|app: 0|req: 1484/2945] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 28 12:31:42 2022] DELETE /identity/v3/projects/2ebb741220af4b4ab0b348ec331bd639 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 12:31:51.833840 dv-cinder-844563-9-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:52.156829 dv-cinder-844563-9-smb devstack@keystone.service[81473]: DEBUG dbcounter [-] [81473] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}